-- Logs begin at Mon 2022-10-17 03:01:46 UTC, end at Mon 2022-10-17 04:09:48 UTC. -- Oct 17 03:44:40.132115 dv-cinder-815582-16-smb systemd[1]: Starting Devstack devstack@n-api.service... Oct 17 03:44:40.140338 dv-cinder-815582-16-smb devstack@n-api.service[110775]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 17 03:44:40.142333 dv-cinder-815582-16-smb devstack@n-api.service[110775]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 17 03:44:40 2022] *** Oct 17 03:44:40.142333 dv-cinder-815582-16-smb devstack@n-api.service[110775]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 17 03:44:40.142333 dv-cinder-815582-16-smb devstack@n-api.service[110775]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 17 03:44:40.142333 dv-cinder-815582-16-smb devstack@n-api.service[110775]: nodename: dv-cinder-815582-16-smb Oct 17 03:44:40.142333 dv-cinder-815582-16-smb devstack@n-api.service[110775]: machine: x86_64 Oct 17 03:44:40.142333 dv-cinder-815582-16-smb devstack@n-api.service[110775]: clock source: unix Oct 17 03:44:40.142776 dv-cinder-815582-16-smb devstack@n-api.service[110775]: pcre jit disabled Oct 17 03:44:40.142776 dv-cinder-815582-16-smb devstack@n-api.service[110775]: detected number of CPU cores: 4 Oct 17 03:44:40.142776 dv-cinder-815582-16-smb devstack@n-api.service[110775]: current working directory: / Oct 17 03:44:40.142776 dv-cinder-815582-16-smb devstack@n-api.service[110775]: detected binary path: /usr/bin/uwsgi-core Oct 17 03:44:40.142776 dv-cinder-815582-16-smb devstack@n-api.service[110775]: your processes number limit is 47680 Oct 17 03:44:40.142776 dv-cinder-815582-16-smb devstack@n-api.service[110775]: your memory page size is 4096 bytes Oct 17 03:44:40.142776 dv-cinder-815582-16-smb devstack@n-api.service[110775]: detected max file descriptor number: 2048 Oct 17 03:44:40.142776 dv-cinder-815582-16-smb devstack@n-api.service[110775]: lock engine: pthread robust mutexes Oct 17 03:44:40.142776 dv-cinder-815582-16-smb devstack@n-api.service[110775]: thunder lock: enabled Oct 17 03:44:40.142776 dv-cinder-815582-16-smb devstack@n-api.service[110775]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 17 03:44:40.142776 dv-cinder-815582-16-smb devstack@n-api.service[110775]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 17 03:44:40.183126 dv-cinder-815582-16-smb devstack@n-api.service[110775]: Python main interpreter initialized at 0x55a321dac9c0 Oct 17 03:44:40.183126 dv-cinder-815582-16-smb devstack@n-api.service[110775]: python threads support enabled Oct 17 03:44:40.183126 dv-cinder-815582-16-smb devstack@n-api.service[110775]: your server socket listen backlog is limited to 100 connections Oct 17 03:44:40.183126 dv-cinder-815582-16-smb devstack@n-api.service[110775]: your mercy for graceful operations on workers is 90 seconds Oct 17 03:44:40.183516 dv-cinder-815582-16-smb devstack@n-api.service[110775]: mapped 403077 bytes (393 KB) for 2 cores Oct 17 03:44:40.183606 dv-cinder-815582-16-smb devstack@n-api.service[110775]: *** Operational MODE: preforking *** Oct 17 03:44:40.183856 dv-cinder-815582-16-smb devstack@n-api.service[110775]: *** uWSGI is running in multiple interpreter mode *** Oct 17 03:44:40.183856 dv-cinder-815582-16-smb devstack@n-api.service[110775]: spawned uWSGI master process (pid: 110775) Oct 17 03:44:40.184046 dv-cinder-815582-16-smb systemd[1]: Started Devstack devstack@n-api.service. Oct 17 03:44:40.184581 dv-cinder-815582-16-smb devstack@n-api.service[110775]: spawned uWSGI worker 1 (pid: 110776, cores: 1) Oct 17 03:44:40.184916 dv-cinder-815582-16-smb devstack@n-api.service[110775]: spawned uWSGI worker 2 (pid: 110777, cores: 1) Oct 17 03:44:40.185531 dv-cinder-815582-16-smb devstack@n-api.service[110775]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 17 03:44:40.838885 dv-cinder-815582-16-smb devstack@n-api.service[110777]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 17 03:44:40.848774 dv-cinder-815582-16-smb devstack@n-api.service[110776]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 17 03:44:41.910064 dv-cinder-815582-16-smb devstack@n-api.service[110777]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 03:44:41.910064 dv-cinder-815582-16-smb devstack@n-api.service[110777]: from cryptography.utils import int_from_bytes Oct 17 03:44:41.910679 dv-cinder-815582-16-smb devstack@n-api.service[110777]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 03:44:41.910679 dv-cinder-815582-16-smb devstack@n-api.service[110777]: from cryptography.utils import int_from_bytes Oct 17 03:44:41.914959 dv-cinder-815582-16-smb devstack@n-api.service[110776]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 03:44:41.914959 dv-cinder-815582-16-smb devstack@n-api.service[110776]: from cryptography.utils import int_from_bytes Oct 17 03:44:41.915938 dv-cinder-815582-16-smb devstack@n-api.service[110776]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 03:44:41.915938 dv-cinder-815582-16-smb devstack@n-api.service[110776]: from cryptography.utils import int_from_bytes Oct 17 03:44:44.383413 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 17 03:44:44.383976 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 17 03:44:44.384618 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 17 03:44:44.384975 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 17 03:44:44.385047 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 17 03:44:44.385120 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 17 03:44:44.385334 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 17 03:44:44.385444 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 17 03:44:44.385707 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.385805 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 17 03:44:44.386000 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 17 03:44:44.386087 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.386588 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.386682 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.386903 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.387019 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.387249 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.387358 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.387557 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.387646 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.387875 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.387979 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.388187 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.388274 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.388517 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.388627 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.388771 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.388860 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.389098 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.389225 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.389397 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.389500 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815582-16-smb {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.389711 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.389798 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.390014 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.390105 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815582-16-smb {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.390322 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.390410 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.390635 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.390729 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.390933 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.391021 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.391275 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.391365 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.391577 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.391662 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.391897 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.392071 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.392235 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.393380 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.393596 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.393806 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.393999 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.394190 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.394381 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.394540 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.394726 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.394906 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.395129 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.395325 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.395511 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.395669 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.395848 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.396069 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.396271 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.396458 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.396616 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.396794 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.396975 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.397222 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815582-16-smb {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.397376 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.397587 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.397783 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815582-16-smb {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.397935 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.398115 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.398311 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.398467 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.398707 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.398844 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.399090 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.399250 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.399383 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.399516 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.399640 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.399806 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.399933 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.400057 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.400187 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.400318 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.400442 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.400563 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.400686 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.400808 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.400942 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.401095 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.401230 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.401354 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.401477 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.401599 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.401729 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.401860 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.401982 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.402104 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.402234 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.402357 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.402488 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.402488 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.402720 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.402842 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.402974 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.403112 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.403264 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.403389 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.403523 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.403647 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.403831 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.403967 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.404096 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.404218 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.404349 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.404473 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.404610 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.404737 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.404873 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.404873 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.405109 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.405232 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.405374 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.405499 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.405623 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.405746 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.405868 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.405868 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.406116 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.406239 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.406362 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.406491 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.406622 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.406753 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.406878 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.407000 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.407121 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.407311 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.407440 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.407572 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.407697 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.407819 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.407941 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.408071 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.408194 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.408325 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.408450 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.408450 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.408710 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.408710 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.409027 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.409153 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.409275 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.409399 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.409522 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.409644 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.409775 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.409909 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.410032 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.410154 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.410283 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.410406 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.410537 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.410660 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.410783 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.410905 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.411064 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.411256 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.411392 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.411523 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.411655 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.411778 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.411901 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.412031 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.412155 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.412289 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.412419 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.412542 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.412666 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.412804 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.412935 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.413058 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.413186 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.413308 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.413453 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.413592 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.413772 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.413900 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.414077 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.414215 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.414385 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.414525 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.414692 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.414820 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.414993 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.415119 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.415338 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.415480 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.415643 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.415777 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.415945 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.416072 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.416243 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.416378 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.416544 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.416678 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.416843 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.416979 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.417144 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.417270 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.417449 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.417579 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.417754 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.417882 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.418051 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.418186 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.418357 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.418493 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.418656 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.418783 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.418996 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.419131 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.419310 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.419447 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.419571 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.419694 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.419868 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.419997 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.420185 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.420310 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.420483 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.420610 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.420782 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.420917 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.421094 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.421229 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.421398 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.421523 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.421697 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.421823 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.422009 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.422137 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.422305 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.422432 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.422631 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.422757 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.422887 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.423011 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.423206 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.423363 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.423512 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.423640 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.423809 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.423937 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.424106 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.424244 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.424403 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.424530 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.424702 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.424829 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.424996 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.425134 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.425294 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.425423 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.425588 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.425723 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.425887 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.426026 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.426188 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.426317 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.426487 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.426621 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.426786 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.426913 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.427084 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.427226 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.427454 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.427595 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.427729 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.427864 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.428022 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.428150 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.428340 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:44:44.428476 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.428674 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.428803 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.429002 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.429207 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.429335 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.429471 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.429622 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.429751 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.429929 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.430075 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.430237 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.430375 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.430558 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.430693 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.431377 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.431513 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.431691 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.431833 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.431997 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.432132 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.432310 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.432436 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.432617 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.432752 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.432925 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.433063 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.433238 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.433370 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.433547 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.433685 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.433859 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.433986 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.434163 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.434297 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.434473 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.434613 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.434791 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.434917 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.435098 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.435244 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.435426 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.435568 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.435759 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.435888 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.436075 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.436201 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.436386 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.436514 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.436702 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.436830 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.437018 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.437147 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.437326 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.437462 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.437620 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.437744 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.437923 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.438051 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.438254 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.438382 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.438560 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.438695 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.438870 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.439006 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.439283 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.439432 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.439558 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.439670 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.439813 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.439952 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.440121 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.440249 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.440426 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.440554 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.440733 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.440869 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.441040 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.441168 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.441344 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.441473 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.441652 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.441787 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.441965 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.442094 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.442274 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.442402 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.442581 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.442721 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.442889 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.443017 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.443225 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.443362 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.443525 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.443655 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.443833 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.443961 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.444140 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.444259 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.444440 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.444569 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.444740 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.444875 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.445041 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.445178 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.445384 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.445510 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.445634 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.445755 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.445924 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.446051 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.446233 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.446363 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.447119 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.447315 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.447441 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.447563 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.447734 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.447862 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.448029 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.448158 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.448337 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.448475 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.448649 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.448791 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.448950 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.449080 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.449258 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.449476 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.449605 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.449729 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.449852 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.449974 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.450160 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.450298 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.450465 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.450594 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.450766 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.450895 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.451084 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.451248 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.451406 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.451536 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.451709 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.451837 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.452019 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.452149 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.452324 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.452450 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.452628 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.452754 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.452937 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.453067 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.453240 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.453369 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.453549 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.453683 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.453856 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.453983 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.454162 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.454291 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.454482 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.454619 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.454794 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.454922 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.455094 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.455238 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.455437 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.455583 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.455756 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.455893 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.456067 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.456204 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.456367 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.456504 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.456669 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.456798 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.456966 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.457094 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.457265 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.457404 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.457564 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.457693 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.457860 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.457983 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.458151 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.458288 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.458451 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.458580 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.458757 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.458885 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.459054 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.459222 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.459375 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.459585 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.459712 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.459835 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.459971 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.460097 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.460252 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.460388 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.460547 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.460673 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.460843 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.460973 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.461154 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.461287 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.461456 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.461597 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.461757 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.461886 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.462109 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.462237 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.462425 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.462561 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.462749 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.462882 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.463059 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.463211 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.463393 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.463534 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.463700 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.463828 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.464007 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.464136 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.464314 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.464450 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.464622 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.464748 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.464934 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.465064 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.465238 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.465372 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.465546 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.465672 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.465847 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.465973 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.466161 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.466289 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.466463 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.466589 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.466776 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.466902 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.467074 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.467338 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.467471 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.467595 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.467719 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.467888 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.468029 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.468155 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.468343 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.468472 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.468667 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.468807 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.468975 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.469104 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.469286 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.469422 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.469633 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.469780 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.469912 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.470036 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.470188 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.470319 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.470494 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.470632 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.470808 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.470944 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.471115 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.471284 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.471453 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.471595 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.471758 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.471887 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.472067 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.472201 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.472372 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.472509 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.472683 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.472809 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.472982 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.473109 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.473292 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.473430 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.473608 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.473742 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.473913 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.474051 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.474257 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.474383 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.474508 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.474638 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.474821 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.474949 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.475131 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.475288 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.475461 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.475591 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.475769 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.475897 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.476071 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.476201 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.476380 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.476507 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.476691 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.476827 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.476997 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.477127 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.477302 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.477428 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.477609 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.477745 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.477948 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.478080 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.478259 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.478386 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.478565 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.478708 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.478868 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.478995 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.479165 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.479348 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.479488 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.479623 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.479826 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.479953 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.480092 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.480223 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.480402 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.480545 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.480718 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.480846 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.481019 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.481147 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.481321 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.481450 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.481640 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.481768 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.481943 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.482070 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.482241 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.482368 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.482544 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.482664 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.482843 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.482972 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.483147 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.483295 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.483476 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.483604 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.483781 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.483910 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.484090 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.484209 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.484407 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.484534 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.484711 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.484847 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.485019 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.485146 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.485324 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.485452 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.485627 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.485764 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.485938 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.486130 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.486259 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.486381 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.486535 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.486676 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.486842 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.486970 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.487149 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.487330 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.487476 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.487617 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.487784 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.487919 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.488081 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.488213 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.488391 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.488519 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.488701 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.488827 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.489007 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.489133 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.489307 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.489436 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.489613 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.489748 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.489949 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.490075 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.490197 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.490474 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.490609 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.490805 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.490934 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.491119 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.491385 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.491519 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.491720 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.491848 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.492038 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.492176 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.492361 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.492503 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.492706 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.492843 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.493014 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.493147 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.493317 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.493944 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.494160 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.494290 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.494464 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.494592 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.494766 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.494903 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.495073 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.495232 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.495398 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.495527 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.495703 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.495842 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.496003 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.496129 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.496310 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.496436 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.496616 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.496757 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.496920 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.497048 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.497223 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.497351 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.497525 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.497661 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.497831 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.497959 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.498115 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.498240 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.498421 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.498627 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.498755 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.498886 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.499010 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.499132 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.499340 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.499471 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.499640 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.499770 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.499995 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.500134 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.500267 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.500392 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.500548 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.500675 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.500847 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.500974 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.501149 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.501277 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.501489 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.501615 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.501792 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.501919 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.502113 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.502240 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.502413 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.502544 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.502733 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.502871 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.503034 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.503162 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.503346 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.503472 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.503644 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.503782 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.503950 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.504087 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.504253 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.504381 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.504550 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.504687 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.504858 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.504985 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.505160 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.505293 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.505460 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.505596 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.505761 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.505888 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.506059 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.506186 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.506362 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.506492 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.506661 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.506798 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.506960 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.507094 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.507285 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.507413 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.507586 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.507716 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.507885 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.508013 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.508185 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.508313 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.508482 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.508610 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.508783 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.508910 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.509627 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.509762 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.509937 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.510080 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.510272 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.510401 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.510538 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.510663 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.510825 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.510955 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.511122 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.511567 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.511699 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.511822 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.511995 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.512123 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.512295 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.512430 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.512605 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.512742 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.512911 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.513044 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.513211 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.513349 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.513496 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.513621 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.513800 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.513928 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.514098 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.514228 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.514396 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.514532 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.514701 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.514828 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.515001 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.515129 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.515329 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.515470 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.515628 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.515754 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.515933 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.516069 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.516232 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.516370 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.516533 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.516663 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.516833 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.516969 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.517134 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.517261 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.517430 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.517567 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.517730 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.517865 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.518028 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.518156 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.518317 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.518449 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.518613 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.518740 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.518912 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.519039 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.519237 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.519389 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.519538 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.519666 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.519844 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.519981 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.520142 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.520298 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.520489 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.520614 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.520740 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.520863 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.521032 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.521163 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.521378 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.521500 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.521683 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.521813 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.521999 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.522126 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.522306 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.522434 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.522614 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.522744 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.522926 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.523055 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.523250 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.523392 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.523563 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.523689 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.523867 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.523995 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.524168 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.524298 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.524466 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.524612 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.524790 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.524929 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.525110 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.525237 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.525416 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.525551 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.525719 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.525847 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.526034 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.526160 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.526344 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.526478 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.526655 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.526789 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.526953 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.527080 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.527284 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.527498 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.527626 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.527749 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.527871 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.527995 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.528177 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.528381 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.528511 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.528634 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.528757 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.528889 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.529067 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.529205 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.529375 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.529503 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.529689 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.529814 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.529994 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.530123 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.530296 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.530423 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.530627 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.530753 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.530886 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.531018 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.531195 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.531327 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.531506 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.531644 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.531810 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.531938 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.532114 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.532248 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.532416 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.532551 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.532717 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.532845 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.533021 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.533147 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.533319 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.533454 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.533620 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.533754 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.533931 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.534059 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.534235 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.534378 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.534612 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.534738 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.534918 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.535046 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.535245 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.535395 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.535563 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.535693 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.535873 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.536001 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.536173 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.536303 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.536486 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.536612 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.536800 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.536928 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.537105 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.537241 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.537464 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.537592 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.537765 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.537899 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.538064 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.538200 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.538373 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.538508 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.538684 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.538811 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.538984 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.539113 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.539314 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.539440 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.539598 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.539739 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.539918 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.540045 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.540232 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.540363 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.540544 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.540757 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.540884 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.541006 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.541157 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.541293 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.541479 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.541618 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.541892 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.542020 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.542202 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.542336 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.542508 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.542648 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.542829 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.542954 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.543149 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.543315 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.543493 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.543622 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.543799 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.543936 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.544114 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.544242 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.544422 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.544551 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.544743 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.544873 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.545058 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.545193 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.545365 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.545491 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.545674 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.545805 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.545976 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.546104 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.546292 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.546426 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.546608 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.546738 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.546913 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.547039 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.547247 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.547377 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.547569 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.547706 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.547883 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.548005 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.548204 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.548346 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.548563 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.548692 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.548884 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.549014 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.549186 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.549324 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.549486 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.549616 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.549797 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.549933 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.550099 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.550237 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.550402 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.550530 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.550795 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.550930 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.551057 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.551242 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.551381 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.551508 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.551631 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.551754 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.551925 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.552056 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.552224 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.552354 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.552523 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.552659 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.552826 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.552954 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.553129 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.553257 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.553427 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.553566 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.553744 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.553940 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.554114 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.554249 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.554374 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.554511 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.554645 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.554776 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.554953 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.555082 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.555277 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.555411 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.555578 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.555715 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.556397 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.556530 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.556699 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.556837 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.557009 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.557136 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.557315 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.557444 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.557617 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.557756 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.557938 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.558065 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.558253 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.558381 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.558545 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.558680 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.558869 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.558998 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.559221 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.559354 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.559523 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.559651 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.559827 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.559961 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.560145 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.560274 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.560465 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.560596 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.560765 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.560970 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.561105 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.561230 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.561362 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.561488 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.561642 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.561770 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.561943 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.562082 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.562243 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.562371 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.562546 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.562675 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.562843 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.562981 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.563142 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.563287 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.563464 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.563604 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.563763 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.563899 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.564067 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.564203 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.564369 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.564498 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.564673 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.564809 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.564973 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.565102 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.565274 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.565409 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.565576 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.565718 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.565880 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.566007 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.566187 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.566316 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.566485 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.566612 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.566801 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.566938 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.567111 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.567275 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.567443 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.567580 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.567757 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.567887 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.568069 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.568198 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.568379 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.568510 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.568676 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.568804 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.568986 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.569133 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.569297 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.569426 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.569599 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.569728 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.569911 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.570053 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.570226 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.570361 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.570536 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.570663 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.570857 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.571076 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.571253 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.571380 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.571546 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.572226 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.572538 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.572674 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.572846 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.572975 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.573155 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.573283 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.573464 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.573593 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.573769 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.573897 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.574074 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.574204 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.574401 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.574535 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.574668 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.574800 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.574975 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.575104 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.575309 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.575439 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.575623 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.575762 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.575948 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.576085 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.576259 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.576389 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.576569 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.576697 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.576878 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.577016 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.577186 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.577316 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.577502 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.577629 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.577817 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.577948 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.578117 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.578251 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.578427 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.578557 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.578734 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.578863 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.579033 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.579162 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.579364 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.579493 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.579672 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.579795 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.579982 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.580103 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.580295 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.580437 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.580601 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.580730 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.580905 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.581033 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.581219 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.581430 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.581535 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.581621 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.581828 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.581925 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.582140 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.582248 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.582454 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.582551 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.582761 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.582856 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.583073 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.583194 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.583407 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.583504 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.583733 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.583919 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.584029 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.584229 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.584340 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.584554 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.584850 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.584942 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.585163 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.585252 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.585474 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.585561 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.585786 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.585885 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.586105 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.586195 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.586405 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.586493 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.586706 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.586803 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.587010 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.587097 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.587376 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.587483 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.587688 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.587789 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.587982 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.588085 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.588286 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.588372 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.588589 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.588694 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.588902 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.588989 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.589206 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.589293 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.589510 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.589733 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.589823 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.590074 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.590170 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.590387 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.590653 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.590743 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.590995 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.591084 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.591337 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.591435 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.591640 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.591738 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.591961 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.592057 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.592263 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.592364 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.592565 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.592662 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.592876 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.592972 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.593182 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.593277 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.593479 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.593566 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.593781 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.593869 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.594087 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.594192 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.594389 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.594485 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.594686 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.594779 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.594990 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.595087 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.595311 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.595414 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.595616 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.595704 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.595921 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.596031 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.596220 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.596318 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.596518 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.596606 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.596824 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.596914 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.597123 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.597219 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.597420 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.597508 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.597718 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.597808 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.598017 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.598105 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.598318 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.598406 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.598614 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.598702 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.598915 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.599003 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.599231 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.599322 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.599539 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.599627 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.599850 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.599937 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.600160 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.600264 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.600467 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.600555 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.600785 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.600872 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.601085 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.601182 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.601386 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.601531 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.601694 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.601782 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.601998 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.602095 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.602300 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.602386 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.602606 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.602692 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.602945 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.603069 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.603286 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.603377 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.603601 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.603690 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.603913 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.604125 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.604258 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.604453 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.604572 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.604768 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.605092 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.605180 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.605417 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.605504 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.605720 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.605808 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.606020 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.606110 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.606322 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.606417 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.606644 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.606733 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.606951 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.607059 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.607280 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.607371 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.607588 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.607687 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.607894 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.607983 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.608198 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.608286 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.608504 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.608600 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.608809 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.608907 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.609116 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.609205 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.609418 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.609513 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.609723 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.609828 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.610025 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.610125 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.610335 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.610426 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.610639 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.610728 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.610943 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.611030 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.611269 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.611360 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.611587 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.611685 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.611897 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.611985 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.612206 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.612302 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.612518 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.612605 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.612831 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.612928 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.613138 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.613226 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.613445 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.613533 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.613751 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.613847 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.614058 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.614145 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.614365 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.614451 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.614674 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.614770 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.614981 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.615068 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.615305 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.615397 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.615630 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.615945 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.616032 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.616253 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.616342 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.616562 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.616880 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.616975 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.617187 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.617275 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.617505 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.617592 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.617823 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.617911 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.618129 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.618216 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.618975 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.619071 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.619302 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.619392 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.619624 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.619710 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.619947 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.620052 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.620261 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.620350 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.620583 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.620671 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.620887 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.620984 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.621189 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.621283 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.621489 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.621599 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.621796 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.621904 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.622106 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.622201 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.622413 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.622502 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.622712 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.622801 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.623012 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.623099 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.623340 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.623442 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.623640 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.623729 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.623943 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.624030 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.624242 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.624328 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.624544 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.624632 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.624848 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.624941 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.625147 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.625241 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.625448 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.625537 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.625744 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.625837 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.626043 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.626142 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.626339 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.626436 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.626638 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.626731 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.626939 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.627041 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.627261 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.627393 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.627564 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.627672 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.627861 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.627968 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.628161 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.628257 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.628458 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.628554 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.628757 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.628863 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.629085 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.629185 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.629359 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.629470 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.629690 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.629795 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.629994 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.630090 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.630314 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.630412 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.630626 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.630731 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.630935 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.631030 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.631274 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.631383 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.631583 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.631693 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.631882 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.631982 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.632207 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.632306 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.632512 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.632609 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.632817 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.632921 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.633123 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.633228 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.633472 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.633572 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.633730 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.633828 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.634566 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.634677 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.634889 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.634987 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.635218 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.635317 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.635527 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.635640 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.635846 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.635943 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.636157 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.636281 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.636720 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.636869 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.637028 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.637174 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.637334 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.637472 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.637653 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.637790 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.637955 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.638091 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.638263 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.638407 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.638549 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.638684 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.638858 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.638996 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.639180 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.639329 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.639474 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.639610 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.639774 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.639913 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.640079 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.640291 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.640429 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.640563 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.640708 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.640843 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.640997 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.641144 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.641294 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.641433 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.641609 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.641764 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.641931 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.642143 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.642287 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.642425 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.642562 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.642709 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.642857 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.642995 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.643159 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.643329 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.643572 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.643723 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.643879 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.644018 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.644155 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.644293 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.644431 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.644586 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.644738 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 17 03:44:44.644878 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.645072 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.645379 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:44:44.645622 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 17 03:44:44.796279 dv-cinder-815582-16-smb devstack@n-api.service[110777]: INFO dbcounter [None req-74c65a2d-c478-4401-b5a2-93a02af8393b None None] Registered counter for database nova_api Oct 17 03:44:44.796967 dv-cinder-815582-16-smb devstack@n-api.service[110776]: INFO dbcounter [None req-7e6daa28-28d0-494e-8c86-a0cf20e39f8c None None] Registered counter for database nova_api Oct 17 03:44:44.817409 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG oslo_db.sqlalchemy.engines [None req-74c65a2d-c478-4401-b5a2-93a02af8393b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110777) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 03:44:44.821100 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG oslo_db.sqlalchemy.engines [None req-7e6daa28-28d0-494e-8c86-a0cf20e39f8c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110776) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 03:44:44.823979 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG dbcounter [-] [110777] Writer thread running {{(pid=110777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 03:44:44.827610 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG dbcounter [-] [110776] Writer thread running {{(pid=110776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 03:44:44.879718 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.context [None req-74c65a2d-c478-4401-b5a2-93a02af8393b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),362d8516-367c-40ac-bf4b-219a46bd8926(cell1) {{(pid=110777) load_cells /opt/stack/nova/nova/context.py:464}} Oct 17 03:44:44.883349 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.context [None req-7e6daa28-28d0-494e-8c86-a0cf20e39f8c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),362d8516-367c-40ac-bf4b-219a46bd8926(cell1) {{(pid=110776) load_cells /opt/stack/nova/nova/context.py:464}} Oct 17 03:44:44.883627 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG oslo_concurrency.lockutils [None req-74c65a2d-c478-4401-b5a2-93a02af8393b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:44:44.884314 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG oslo_concurrency.lockutils [None req-74c65a2d-c478-4401-b5a2-93a02af8393b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:44:44.885618 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG oslo_concurrency.lockutils [None req-74c65a2d-c478-4401-b5a2-93a02af8393b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:44:44.886596 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG oslo_concurrency.lockutils [None req-74c65a2d-c478-4401-b5a2-93a02af8393b None None] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:44:44.887037 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG oslo_concurrency.lockutils [None req-74c65a2d-c478-4401-b5a2-93a02af8393b None None] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:44:44.887495 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG oslo_concurrency.lockutils [None req-7e6daa28-28d0-494e-8c86-a0cf20e39f8c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:44:44.887969 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG oslo_concurrency.lockutils [None req-7e6daa28-28d0-494e-8c86-a0cf20e39f8c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:44:44.889004 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG oslo_concurrency.lockutils [None req-74c65a2d-c478-4401-b5a2-93a02af8393b None None] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:44:44.889543 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG oslo_concurrency.lockutils [None req-7e6daa28-28d0-494e-8c86-a0cf20e39f8c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:44:44.890270 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG oslo_concurrency.lockutils [None req-7e6daa28-28d0-494e-8c86-a0cf20e39f8c None None] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:44:44.890718 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG oslo_concurrency.lockutils [None req-7e6daa28-28d0-494e-8c86-a0cf20e39f8c None None] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:44:44.890949 dv-cinder-815582-16-smb devstack@n-api.service[110777]: INFO dbcounter [None req-74c65a2d-c478-4401-b5a2-93a02af8393b None None] Registered counter for database nova_cell0 Oct 17 03:44:44.892727 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG oslo_concurrency.lockutils [None req-7e6daa28-28d0-494e-8c86-a0cf20e39f8c None None] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:44:44.894689 dv-cinder-815582-16-smb devstack@n-api.service[110776]: INFO dbcounter [None req-7e6daa28-28d0-494e-8c86-a0cf20e39f8c None None] Registered counter for database nova_cell0 Oct 17 03:44:44.894874 dv-cinder-815582-16-smb devstack@n-api.service[110777]: INFO dbcounter [None req-74c65a2d-c478-4401-b5a2-93a02af8393b None None] Registered counter for database nova_cell1 Oct 17 03:44:44.898613 dv-cinder-815582-16-smb devstack@n-api.service[110776]: INFO dbcounter [None req-7e6daa28-28d0-494e-8c86-a0cf20e39f8c None None] Registered counter for database nova_cell1 Oct 17 03:44:44.902280 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG oslo_db.sqlalchemy.engines [None req-74c65a2d-c478-4401-b5a2-93a02af8393b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110777) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 03:44:44.904126 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG oslo_db.sqlalchemy.engines [None req-74c65a2d-c478-4401-b5a2-93a02af8393b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110777) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 03:44:44.905991 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG oslo_db.sqlalchemy.engines [None req-7e6daa28-28d0-494e-8c86-a0cf20e39f8c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110776) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 03:44:44.907228 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG oslo_db.sqlalchemy.engines [None req-7e6daa28-28d0-494e-8c86-a0cf20e39f8c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110776) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 03:44:44.911569 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG dbcounter [-] [110777] Writer thread running {{(pid=110777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 03:44:44.913014 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG dbcounter [-] [110777] Writer thread running {{(pid=110777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 03:44:44.913795 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG dbcounter [-] [110776] Writer thread running {{(pid=110776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 03:44:44.915881 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG dbcounter [-] [110776] Writer thread running {{(pid=110776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 03:44:45.056297 dv-cinder-815582-16-smb devstack@n-api.service[110777]: INFO dbcounter [None req-74c65a2d-c478-4401-b5a2-93a02af8393b None None] Registered counter for database nova_cell0 Oct 17 03:44:45.059357 dv-cinder-815582-16-smb devstack@n-api.service[110776]: INFO dbcounter [None req-7e6daa28-28d0-494e-8c86-a0cf20e39f8c None None] Registered counter for database nova_cell0 Oct 17 03:44:45.065023 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG oslo_db.sqlalchemy.engines [None req-74c65a2d-c478-4401-b5a2-93a02af8393b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110777) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 03:44:45.068604 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG oslo_db.sqlalchemy.engines [None req-7e6daa28-28d0-494e-8c86-a0cf20e39f8c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110776) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 03:44:45.070044 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG dbcounter [-] [110777] Writer thread running {{(pid=110777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 03:44:45.073278 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG dbcounter [-] [110776] Writer thread running {{(pid=110776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 03:44:45.509687 dv-cinder-815582-16-smb devstack@n-api.service[110777]: WARNING keystonemiddleware.auth_token [None req-74c65a2d-c478-4401-b5a2-93a02af8393b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 03:44:45.517210 dv-cinder-815582-16-smb devstack@n-api.service[110777]: WARNING keystonemiddleware.auth_token [None req-74c65a2d-c478-4401-b5a2-93a02af8393b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 03:44:45.519996 dv-cinder-815582-16-smb devstack@n-api.service[110776]: WARNING keystonemiddleware.auth_token [None req-7e6daa28-28d0-494e-8c86-a0cf20e39f8c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 03:44:45.527920 dv-cinder-815582-16-smb devstack@n-api.service[110776]: WARNING keystonemiddleware.auth_token [None req-7e6daa28-28d0-494e-8c86-a0cf20e39f8c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 03:44:45.857926 dv-cinder-815582-16-smb devstack@n-api.service[110777]: WARNING keystonemiddleware.auth_token [None req-74c65a2d-c478-4401-b5a2-93a02af8393b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 03:44:45.863808 dv-cinder-815582-16-smb devstack@n-api.service[110777]: WARNING keystonemiddleware.auth_token [None req-74c65a2d-c478-4401-b5a2-93a02af8393b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 03:44:45.864827 dv-cinder-815582-16-smb devstack@n-api.service[110776]: WARNING keystonemiddleware.auth_token [None req-7e6daa28-28d0-494e-8c86-a0cf20e39f8c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 03:44:45.869605 dv-cinder-815582-16-smb devstack@n-api.service[110777]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a321dac9c0 pid: 110777 (default app) Oct 17 03:44:45.871305 dv-cinder-815582-16-smb devstack@n-api.service[110776]: WARNING keystonemiddleware.auth_token [None req-7e6daa28-28d0-494e-8c86-a0cf20e39f8c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 03:44:45.871696 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi [None req-74c65a2d-c478-4401-b5a2-93a02af8393b None None] Calling method '>' {{(pid=110777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:44:45.872868 dv-cinder-815582-16-smb devstack@n-api.service[110777]: INFO nova.api.openstack.requestlog [None req-74c65a2d-c478-4401-b5a2-93a02af8393b None None] 10.222.0.16 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001748 Oct 17 03:44:45.873282 dv-cinder-815582-16-smb devstack@n-api.service[110777]: [pid: 110777|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 788 bytes} [Mon Oct 17 03:44:45 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:44:45.876491 dv-cinder-815582-16-smb devstack@n-api.service[110776]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a321dac9c0 pid: 110776 (default app) Oct 17 03:46:09.508045 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi [None req-74c65a2d-c478-4401-b5a2-93a02af8393b None None] Calling method '>' {{(pid=110777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:46:09.509051 dv-cinder-815582-16-smb devstack@n-api.service[110777]: INFO nova.api.openstack.requestlog [None req-74c65a2d-c478-4401-b5a2-93a02af8393b None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001973 Oct 17 03:46:09.509435 dv-cinder-815582-16-smb devstack@n-api.service[110777]: [pid: 110777|app: 0|req: 2/2] 10.222.0.16 () {54 vars in 931 bytes} [Mon Oct 17 03:46:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:46:09.523775 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG dbcounter [-] [110776] Writing DB stats nova_api:SELECT=3 {{(pid=110776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:46:09.524893 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG dbcounter [-] [110776] Writing DB stats nova_cell1:SELECT=3 {{(pid=110776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:46:09.525889 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG dbcounter [-] [110776] Writing DB stats nova_cell0:SELECT=3 {{(pid=110776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:46:09.526927 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG dbcounter [-] [110776] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:46:10.399812 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi [None req-67354829-ffb2-40b3-a3b2-3446f8780593 admin admin] Calling method '>' {{(pid=110776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:46:10.434768 dv-cinder-815582-16-smb devstack@n-api.service[110776]: INFO nova.api.openstack.requestlog [None req-67354829-ffb2-40b3-a3b2-3446f8780593 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.916581 Oct 17 03:46:10.447499 dv-cinder-815582-16-smb devstack@n-api.service[110776]: [pid: 110776|app: 0|req: 1/3] 10.222.0.16 () {60 vars in 1292 bytes} [Mon Oct 17 03:46:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:46:13.038026 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi [None req-74c65a2d-c478-4401-b5a2-93a02af8393b None None] Calling method '>' {{(pid=110777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:46:13.039628 dv-cinder-815582-16-smb devstack@n-api.service[110777]: INFO nova.api.openstack.requestlog [None req-74c65a2d-c478-4401-b5a2-93a02af8393b None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002001 Oct 17 03:46:13.043560 dv-cinder-815582-16-smb devstack@n-api.service[110777]: [pid: 110777|app: 0|req: 3/4] 10.222.0.16 () {54 vars in 931 bytes} [Mon Oct 17 03:46:13 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:46:13.477038 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi [None req-7e94d2db-2037-4db0-a406-777d5b82fb68 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "c1", "name": "cirros256", "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 1, "vcpus": 1}} {{(pid=110776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:46:13.591606 dv-cinder-815582-16-smb devstack@n-api.service[110776]: INFO nova.api.openstack.requestlog [None req-7e94d2db-2037-4db0-a406-777d5b82fb68 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.545493 Oct 17 03:46:13.592167 dv-cinder-815582-16-smb devstack@n-api.service[110776]: [pid: 110776|app: 0|req: 2/5] 10.222.0.16 () {64 vars in 1283 bytes} [Mon Oct 17 03:46:13 2022] POST /compute/v2.1/flavors => generated 407 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 03:46:13.606026 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG dbcounter [-] [110777] Writing DB stats nova_api:SELECT=3 {{(pid=110777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:46:13.606896 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG dbcounter [-] [110777] Writing DB stats nova_cell0:SELECT=3 {{(pid=110777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:46:13.608860 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG dbcounter [-] [110777] Writing DB stats nova_cell1:SELECT=3 {{(pid=110777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:46:13.609617 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG dbcounter [-] [110777] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:46:13.816212 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi [None req-7014ccf7-3049-46c7-bd70-3d87d255f22a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:46:13.949122 dv-cinder-815582-16-smb devstack@n-api.service[110777]: INFO nova.api.openstack.requestlog [None req-7014ccf7-3049-46c7-bd70-3d87d255f22a admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.348304 Oct 17 03:46:13.949903 dv-cinder-815582-16-smb devstack@n-api.service[110777]: [pid: 110777|app: 0|req: 4/6] 10.222.0.16 () {64 vars in 1336 bytes} [Mon Oct 17 03:46:13 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:46:16.541707 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi [None req-7e94d2db-2037-4db0-a406-777d5b82fb68 admin admin] Calling method '>' {{(pid=110776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:46:16.542714 dv-cinder-815582-16-smb devstack@n-api.service[110776]: INFO nova.api.openstack.requestlog [None req-7e94d2db-2037-4db0-a406-777d5b82fb68 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Oct 17 03:46:16.543107 dv-cinder-815582-16-smb devstack@n-api.service[110776]: [pid: 110776|app: 0|req: 3/7] 10.222.0.16 () {54 vars in 931 bytes} [Mon Oct 17 03:46:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:46:17.218531 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi [None req-499b2a26-dd06-4968-8457-64ee3e1f67cb admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d1", "os-flavor-access:is_public": true, "name": "ds512M", "disk": 5, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "rxtx_factor": 1.0}} {{(pid=110777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:46:17.337375 dv-cinder-815582-16-smb devstack@n-api.service[110777]: INFO nova.api.openstack.requestlog [None req-499b2a26-dd06-4968-8457-64ee3e1f67cb admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.788024 Oct 17 03:46:17.338121 dv-cinder-815582-16-smb devstack@n-api.service[110777]: [pid: 110777|app: 0|req: 5/8] 10.222.0.16 () {64 vars in 1283 bytes} [Mon Oct 17 03:46:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 03:46:17.350253 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi [None req-a5bbc9ca-9ad3-487f-bc60-54b68063f615 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:46:17.472629 dv-cinder-815582-16-smb devstack@n-api.service[110776]: INFO nova.api.openstack.requestlog [None req-a5bbc9ca-9ad3-487f-bc60-54b68063f615 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.125930 Oct 17 03:46:17.481405 dv-cinder-815582-16-smb devstack@n-api.service[110776]: [pid: 110776|app: 0|req: 4/9] 10.222.0.16 () {64 vars in 1336 bytes} [Mon Oct 17 03:46:17 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:46:20.102506 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi [None req-499b2a26-dd06-4968-8457-64ee3e1f67cb admin admin] Calling method '>' {{(pid=110777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:46:20.103542 dv-cinder-815582-16-smb devstack@n-api.service[110777]: INFO nova.api.openstack.requestlog [None req-499b2a26-dd06-4968-8457-64ee3e1f67cb admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Oct 17 03:46:20.103959 dv-cinder-815582-16-smb devstack@n-api.service[110777]: [pid: 110777|app: 0|req: 6/10] 10.222.0.16 () {54 vars in 931 bytes} [Mon Oct 17 03:46:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:46:20.529676 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi [None req-ea7b0006-b0e4-405d-baf5-c9919f4a4c41 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "vcpus": 1, "disk": 10, "os-flavor-access:is_public": true, "id": "d2", "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0}} {{(pid=110776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:46:20.604974 dv-cinder-815582-16-smb devstack@n-api.service[110776]: INFO nova.api.openstack.requestlog [None req-ea7b0006-b0e4-405d-baf5-c9919f4a4c41 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.495062 Oct 17 03:46:20.605535 dv-cinder-815582-16-smb devstack@n-api.service[110776]: [pid: 110776|app: 0|req: 5/11] 10.222.0.16 () {64 vars in 1283 bytes} [Mon Oct 17 03:46:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 03:46:20.618365 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi [None req-2242292a-aaf4-4e3b-a263-ddaf084cef17 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:46:20.701346 dv-cinder-815582-16-smb devstack@n-api.service[110777]: INFO nova.api.openstack.requestlog [None req-2242292a-aaf4-4e3b-a263-ddaf084cef17 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.087193 Oct 17 03:46:20.701933 dv-cinder-815582-16-smb devstack@n-api.service[110777]: [pid: 110777|app: 0|req: 7/12] 10.222.0.16 () {64 vars in 1336 bytes} [Mon Oct 17 03:46:20 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:46:23.309641 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi [None req-ea7b0006-b0e4-405d-baf5-c9919f4a4c41 admin admin] Calling method '>' {{(pid=110776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:46:23.310581 dv-cinder-815582-16-smb devstack@n-api.service[110776]: INFO nova.api.openstack.requestlog [None req-ea7b0006-b0e4-405d-baf5-c9919f4a4c41 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Oct 17 03:46:23.311494 dv-cinder-815582-16-smb devstack@n-api.service[110776]: [pid: 110776|app: 0|req: 6/13] 10.222.0.16 () {54 vars in 931 bytes} [Mon Oct 17 03:46:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:46:23.726379 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi [None req-bb651a28-0036-4ab6-aedd-568bf55f22c3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "vcpus": 2, "name": "ds2G", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 10, "ram": 2048, "swap": 0}} {{(pid=110777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:46:23.811286 dv-cinder-815582-16-smb devstack@n-api.service[110777]: INFO nova.api.openstack.requestlog [None req-bb651a28-0036-4ab6-aedd-568bf55f22c3 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.494229 Oct 17 03:46:23.812029 dv-cinder-815582-16-smb devstack@n-api.service[110777]: [pid: 110777|app: 0|req: 8/14] 10.222.0.16 () {64 vars in 1283 bytes} [Mon Oct 17 03:46:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 03:46:23.824194 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi [None req-bc50f68e-daef-4ef5-a66d-e426b7fb1d46 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:46:23.906110 dv-cinder-815582-16-smb devstack@n-api.service[110776]: INFO nova.api.openstack.requestlog [None req-bc50f68e-daef-4ef5-a66d-e426b7fb1d46 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085575 Oct 17 03:46:23.906933 dv-cinder-815582-16-smb devstack@n-api.service[110776]: [pid: 110776|app: 0|req: 7/15] 10.222.0.16 () {64 vars in 1336 bytes} [Mon Oct 17 03:46:23 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:46:26.533552 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi [None req-bb651a28-0036-4ab6-aedd-568bf55f22c3 admin admin] Calling method '>' {{(pid=110777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:46:26.534533 dv-cinder-815582-16-smb devstack@n-api.service[110777]: INFO nova.api.openstack.requestlog [None req-bb651a28-0036-4ab6-aedd-568bf55f22c3 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Oct 17 03:46:26.534957 dv-cinder-815582-16-smb devstack@n-api.service[110777]: [pid: 110777|app: 0|req: 9/16] 10.222.0.16 () {54 vars in 931 bytes} [Mon Oct 17 03:46:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:46:27.023344 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi [None req-4b743c78-e049-42d8-aa5a-62af6a4097b4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "disk": 20, "rxtx_factor": 1.0, "ram": 4096, "vcpus": 4, "os-flavor-access:is_public": true, "id": "d4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:46:27.095803 dv-cinder-815582-16-smb devstack@n-api.service[110776]: INFO nova.api.openstack.requestlog [None req-4b743c78-e049-42d8-aa5a-62af6a4097b4 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.553257 Oct 17 03:46:27.096510 dv-cinder-815582-16-smb devstack@n-api.service[110776]: [pid: 110776|app: 0|req: 8/17] 10.222.0.16 () {64 vars in 1283 bytes} [Mon Oct 17 03:46:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 03:46:27.112145 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi [None req-d5fb9233-a9ee-4eb5-aff7-aa95a2468e78 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:46:27.243588 dv-cinder-815582-16-smb devstack@n-api.service[110777]: INFO nova.api.openstack.requestlog [None req-d5fb9233-a9ee-4eb5-aff7-aa95a2468e78 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.136176 Oct 17 03:46:27.445973 dv-cinder-815582-16-smb devstack@n-api.service[110777]: [pid: 110777|app: 0|req: 10/18] 10.222.0.16 () {64 vars in 1336 bytes} [Mon Oct 17 03:46:27 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:46:30.037761 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi [None req-4b743c78-e049-42d8-aa5a-62af6a4097b4 admin admin] Calling method '>' {{(pid=110776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:46:30.039107 dv-cinder-815582-16-smb devstack@n-api.service[110776]: INFO nova.api.openstack.requestlog [None req-4b743c78-e049-42d8-aa5a-62af6a4097b4 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001881 Oct 17 03:46:30.039669 dv-cinder-815582-16-smb devstack@n-api.service[110776]: [pid: 110776|app: 0|req: 9/19] 10.222.0.16 () {54 vars in 931 bytes} [Mon Oct 17 03:46:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:46:30.471448 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi [None req-5509b685-32ca-4d06-ba65-d8a33d6a2182 admin admin] Calling method '>' {{(pid=110777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:46:30.496944 dv-cinder-815582-16-smb devstack@n-api.service[110777]: INFO nova.api.openstack.requestlog [None req-5509b685-32ca-4d06-ba65-d8a33d6a2182 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.449728 Oct 17 03:46:30.497601 dv-cinder-815582-16-smb devstack@n-api.service[110777]: [pid: 110777|app: 0|req: 11/20] 10.222.0.16 () {60 vars in 1292 bytes} [Mon Oct 17 03:46:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:46:33.322226 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi [None req-4b743c78-e049-42d8-aa5a-62af6a4097b4 admin admin] Calling method '>' {{(pid=110776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:46:33.323167 dv-cinder-815582-16-smb devstack@n-api.service[110776]: INFO nova.api.openstack.requestlog [None req-4b743c78-e049-42d8-aa5a-62af6a4097b4 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Oct 17 03:46:33.323620 dv-cinder-815582-16-smb devstack@n-api.service[110776]: [pid: 110776|app: 0|req: 10/21] 10.222.0.16 () {54 vars in 931 bytes} [Mon Oct 17 03:46:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:46:33.715378 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi [None req-32d415dd-33a3-45a9-a47a-6a8261b11d73 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "ram": 512, "id": "1", "name": "m1.tiny", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "os-flavor-access:is_public": true}} {{(pid=110777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:46:33.789759 dv-cinder-815582-16-smb devstack@n-api.service[110777]: INFO nova.api.openstack.requestlog [None req-32d415dd-33a3-45a9-a47a-6a8261b11d73 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.459871 Oct 17 03:46:33.790330 dv-cinder-815582-16-smb devstack@n-api.service[110777]: [pid: 110777|app: 0|req: 12/22] 10.222.0.16 () {64 vars in 1283 bytes} [Mon Oct 17 03:46:33 2022] POST /compute/v2.1/flavors => generated 402 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 03:46:33.802794 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi [None req-3d522cb0-e0d3-4d06-a666-69f46f780b01 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:46:33.889252 dv-cinder-815582-16-smb devstack@n-api.service[110776]: INFO nova.api.openstack.requestlog [None req-3d522cb0-e0d3-4d06-a666-69f46f780b01 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090103 Oct 17 03:46:33.889760 dv-cinder-815582-16-smb devstack@n-api.service[110776]: [pid: 110776|app: 0|req: 11/23] 10.222.0.16 () {64 vars in 1333 bytes} [Mon Oct 17 03:46:33 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:46:36.470598 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi [None req-32d415dd-33a3-45a9-a47a-6a8261b11d73 admin admin] Calling method '>' {{(pid=110777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:46:36.471651 dv-cinder-815582-16-smb devstack@n-api.service[110777]: INFO nova.api.openstack.requestlog [None req-32d415dd-33a3-45a9-a47a-6a8261b11d73 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Oct 17 03:46:36.472053 dv-cinder-815582-16-smb devstack@n-api.service[110777]: [pid: 110777|app: 0|req: 13/24] 10.222.0.16 () {54 vars in 931 bytes} [Mon Oct 17 03:46:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:46:36.826323 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi [None req-f56fe4e7-8f28-4999-b32a-4e96c318cc73 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "ram": 2048, "id": "2", "name": "m1.small", "disk": 20, "os-flavor-access:is_public": true}} {{(pid=110776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:46:36.914003 dv-cinder-815582-16-smb devstack@n-api.service[110776]: INFO nova.api.openstack.requestlog [None req-f56fe4e7-8f28-4999-b32a-4e96c318cc73 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.435365 Oct 17 03:46:36.914560 dv-cinder-815582-16-smb devstack@n-api.service[110776]: [pid: 110776|app: 0|req: 12/25] 10.222.0.16 () {64 vars in 1283 bytes} [Mon Oct 17 03:46:36 2022] POST /compute/v2.1/flavors => generated 405 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 03:46:36.926517 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi [None req-86d8df5a-71a5-4ea0-a039-dafc096b536b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:46:37.008350 dv-cinder-815582-16-smb devstack@n-api.service[110777]: INFO nova.api.openstack.requestlog [None req-86d8df5a-71a5-4ea0-a039-dafc096b536b admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085499 Oct 17 03:46:37.009260 dv-cinder-815582-16-smb devstack@n-api.service[110777]: [pid: 110777|app: 0|req: 14/26] 10.222.0.16 () {64 vars in 1333 bytes} [Mon Oct 17 03:46:36 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:46:39.679287 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi [None req-f56fe4e7-8f28-4999-b32a-4e96c318cc73 admin admin] Calling method '>' {{(pid=110776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:46:39.680263 dv-cinder-815582-16-smb devstack@n-api.service[110776]: INFO nova.api.openstack.requestlog [None req-f56fe4e7-8f28-4999-b32a-4e96c318cc73 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 Oct 17 03:46:39.680676 dv-cinder-815582-16-smb devstack@n-api.service[110776]: [pid: 110776|app: 0|req: 13/27] 10.222.0.16 () {54 vars in 931 bytes} [Mon Oct 17 03:46:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:46:40.139431 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi [None req-574ff420-bc98-4225-99db-913ba88560a7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "name": "m1.medium", "disk": 40, "ram": 4096, "vcpus": 2, "os-flavor-access:is_public": true, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:46:40.252112 dv-cinder-815582-16-smb devstack@n-api.service[110777]: INFO nova.api.openstack.requestlog [None req-574ff420-bc98-4225-99db-913ba88560a7 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.565323 Oct 17 03:46:40.253037 dv-cinder-815582-16-smb devstack@n-api.service[110777]: [pid: 110777|app: 0|req: 15/28] 10.222.0.16 () {64 vars in 1283 bytes} [Mon Oct 17 03:46:39 2022] POST /compute/v2.1/flavors => generated 406 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 03:46:40.265970 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi [None req-09f4b411-119f-410e-ab74-b71622eefbf6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:46:40.271496 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG dbcounter [-] [110776] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=110776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:46:40.345515 dv-cinder-815582-16-smb devstack@n-api.service[110776]: INFO nova.api.openstack.requestlog [None req-09f4b411-119f-410e-ab74-b71622eefbf6 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.083667 Oct 17 03:46:40.346217 dv-cinder-815582-16-smb devstack@n-api.service[110776]: [pid: 110776|app: 0|req: 14/29] 10.222.0.16 () {64 vars in 1333 bytes} [Mon Oct 17 03:46:40 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:46:42.955972 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi [None req-574ff420-bc98-4225-99db-913ba88560a7 admin admin] Calling method '>' {{(pid=110777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:46:42.957631 dv-cinder-815582-16-smb devstack@n-api.service[110777]: INFO nova.api.openstack.requestlog [None req-574ff420-bc98-4225-99db-913ba88560a7 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002126 Oct 17 03:46:42.958037 dv-cinder-815582-16-smb devstack@n-api.service[110777]: [pid: 110777|app: 0|req: 16/30] 10.222.0.16 () {54 vars in 931 bytes} [Mon Oct 17 03:46:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:46:43.456535 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi [None req-05d512ed-c7c8-4ae1-8e58-f2c2483ab598 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "disk": 80, "swap": 0, "rxtx_factor": 1.0, "name": "m1.large", "os-flavor-access:is_public": true, "ram": 8192, "id": "4"}} {{(pid=110776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:46:43.927219 dv-cinder-815582-16-smb devstack@n-api.service[110776]: INFO nova.api.openstack.requestlog [None req-05d512ed-c7c8-4ae1-8e58-f2c2483ab598 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.962376 Oct 17 03:46:43.927814 dv-cinder-815582-16-smb devstack@n-api.service[110776]: [pid: 110776|app: 0|req: 15/31] 10.222.0.16 () {64 vars in 1283 bytes} [Mon Oct 17 03:46:42 2022] POST /compute/v2.1/flavors => generated 405 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 03:46:43.939826 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi [None req-12c3dc33-cbcf-49c6-88bc-b794a722c205 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:46:43.945515 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG dbcounter [-] [110777] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=110777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:46:44.025960 dv-cinder-815582-16-smb devstack@n-api.service[110777]: INFO nova.api.openstack.requestlog [None req-12c3dc33-cbcf-49c6-88bc-b794a722c205 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.089619 Oct 17 03:46:44.026587 dv-cinder-815582-16-smb devstack@n-api.service[110777]: [pid: 110777|app: 0|req: 17/32] 10.222.0.16 () {64 vars in 1333 bytes} [Mon Oct 17 03:46:43 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:46:46.657019 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi [None req-05d512ed-c7c8-4ae1-8e58-f2c2483ab598 admin admin] Calling method '>' {{(pid=110776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:46:46.658035 dv-cinder-815582-16-smb devstack@n-api.service[110776]: INFO nova.api.openstack.requestlog [None req-05d512ed-c7c8-4ae1-8e58-f2c2483ab598 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Oct 17 03:46:46.659026 dv-cinder-815582-16-smb devstack@n-api.service[110776]: [pid: 110776|app: 0|req: 16/33] 10.222.0.16 () {54 vars in 931 bytes} [Mon Oct 17 03:46:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:46:47.122934 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi [None req-e86eca3e-2f29-4fb8-8a1b-7808a67490ca admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 8, "ram": 16384, "os-flavor-access:is_public": true, "id": "5", "name": "m1.xlarge"}} {{(pid=110777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:46:47.181563 dv-cinder-815582-16-smb devstack@n-api.service[110777]: INFO nova.api.openstack.requestlog [None req-e86eca3e-2f29-4fb8-8a1b-7808a67490ca admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.516000 Oct 17 03:46:47.187224 dv-cinder-815582-16-smb devstack@n-api.service[110777]: [pid: 110777|app: 0|req: 18/34] 10.222.0.16 () {64 vars in 1283 bytes} [Mon Oct 17 03:46:46 2022] POST /compute/v2.1/flavors => generated 408 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 03:46:47.195306 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi [None req-259f2815-6d35-49a2-bc8a-ff582f67a385 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:46:47.266141 dv-cinder-815582-16-smb devstack@n-api.service[110776]: INFO nova.api.openstack.requestlog [None req-259f2815-6d35-49a2-bc8a-ff582f67a385 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.075246 Oct 17 03:46:47.266776 dv-cinder-815582-16-smb devstack@n-api.service[110776]: [pid: 110776|app: 0|req: 17/35] 10.222.0.16 () {64 vars in 1333 bytes} [Mon Oct 17 03:46:47 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:47:03.870768 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi [None req-e86eca3e-2f29-4fb8-8a1b-7808a67490ca admin admin] Calling method '>' {{(pid=110777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:47:03.871805 dv-cinder-815582-16-smb devstack@n-api.service[110777]: INFO nova.api.openstack.requestlog [None req-e86eca3e-2f29-4fb8-8a1b-7808a67490ca admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Oct 17 03:47:03.872210 dv-cinder-815582-16-smb devstack@n-api.service[110777]: [pid: 110777|app: 0|req: 19/36] 10.222.0.16 () {54 vars in 931 bytes} [Mon Oct 17 03:47:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:47:03.882492 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG dbcounter [-] [110776] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=110776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:47:04.255102 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi [None req-f2b13a53-bbfe-4db5-b5ac-765bb5d63b7f admin admin] Calling method '>' {{(pid=110776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:47:04.274366 dv-cinder-815582-16-smb devstack@n-api.service[110776]: INFO nova.api.openstack.requestlog [None req-f2b13a53-bbfe-4db5-b5ac-765bb5d63b7f admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.396279 Oct 17 03:47:04.274896 dv-cinder-815582-16-smb devstack@n-api.service[110776]: [pid: 110776|app: 0|req: 18/37] 10.222.0.16 () {60 vars in 1292 bytes} [Mon Oct 17 03:47:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:47:05.593268 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi [None req-e86eca3e-2f29-4fb8-8a1b-7808a67490ca admin admin] Calling method '>' {{(pid=110777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:47:05.594266 dv-cinder-815582-16-smb devstack@n-api.service[110777]: INFO nova.api.openstack.requestlog [None req-e86eca3e-2f29-4fb8-8a1b-7808a67490ca admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Oct 17 03:47:05.594681 dv-cinder-815582-16-smb devstack@n-api.service[110777]: [pid: 110777|app: 0|req: 20/38] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Oct 17 03:47:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:47:06.118981 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi [None req-e0f62305-a9ce-4cbb-8bd2-bce5ba8302b5 admin admin] Calling method '>' {{(pid=110776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:47:06.124264 dv-cinder-815582-16-smb devstack@n-api.service[110776]: INFO nova.api.openstack.wsgi [None req-e0f62305-a9ce-4cbb-8bd2-bce5ba8302b5 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 17 03:47:06.127450 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi [None req-e0f62305-a9ce-4cbb-8bd2-bce5ba8302b5 admin admin] Request method failure captured: Oct 17 03:47:06.127450 dv-cinder-815582-16-smb devstack@n-api.service[110776]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 17 03:47:06.127450 dv-cinder-815582-16-smb devstack@n-api.service[110776]: Accept: application/json Oct 17 03:47:06.127450 dv-cinder-815582-16-smb devstack@n-api.service[110776]: Accept-Encoding: gzip, deflate Oct 17 03:47:06.127450 dv-cinder-815582-16-smb devstack@n-api.service[110776]: Connection: keep-alive Oct 17 03:47:06.127450 dv-cinder-815582-16-smb devstack@n-api.service[110776]: Content-Length: 0 Oct 17 03:47:06.127450 dv-cinder-815582-16-smb devstack@n-api.service[110776]: Host: 10.222.0.16 Oct 17 03:47:06.127450 dv-cinder-815582-16-smb devstack@n-api.service[110776]: Openstack-Api-Version: compute 2.92 Oct 17 03:47:06.127450 dv-cinder-815582-16-smb devstack@n-api.service[110776]: Openstack-System-Scope: None Oct 17 03:47:06.127450 dv-cinder-815582-16-smb devstack@n-api.service[110776]: User-Agent: python-novaclient Oct 17 03:47:06.127450 dv-cinder-815582-16-smb devstack@n-api.service[110776]: X-Auth-Token: gAAAAABjTNA561qZvAuHGNFoqj_B7r00ZAjKdRbk7ADU6Oo92_fEK-HbyxGHRMfoByFJQSThPn1Ii_QgZYvVn8y1ieo4I5mRqz6I7VX1DCd65Er2xsS0U2IDHtf76BKnJlHqRySgVSGfjE-q1OtXe41zvqZBWQz2_LonIsfR8ryIPBMRXaCNs1I Oct 17 03:47:06.127450 dv-cinder-815582-16-smb devstack@n-api.service[110776]: X-Domain-Id: None Oct 17 03:47:06.127450 dv-cinder-815582-16-smb devstack@n-api.service[110776]: X-Domain-Name: None Oct 17 03:47:06.127450 dv-cinder-815582-16-smb devstack@n-api.service[110776]: X-Identity-Status: Confirmed Oct 17 03:47:06.127450 dv-cinder-815582-16-smb devstack@n-api.service[110776]: X-Is-Admin-Project: True Oct 17 03:47:06.127450 dv-cinder-815582-16-smb devstack@n-api.service[110776]: X-Openstack-Nova-Api-Version: 2.92 Oct 17 03:47:06.127450 dv-cinder-815582-16-smb devstack@n-api.service[110776]: X-Project-Domain-Id: default Oct 17 03:47:06.127450 dv-cinder-815582-16-smb devstack@n-api.service[110776]: X-Project-Domain-Name: Default Oct 17 03:47:06.127450 dv-cinder-815582-16-smb devstack@n-api.service[110776]: X-Project-Id: 62ffad17d53a46df98f50d7ef062c594 Oct 17 03:47:06.127450 dv-cinder-815582-16-smb devstack@n-api.service[110776]: X-Project-Name: admin Oct 17 03:47:06.127450 dv-cinder-815582-16-smb devstack@n-api.service[110776]: X-Role: reader,member,admin Oct 17 03:47:06.127450 dv-cinder-815582-16-smb devstack@n-api.service[110776]: X-Roles: reader,member,admin Oct 17 03:47:06.129224 dv-cinder-815582-16-smb devstack@n-api.service[110776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/62ffad17d53a46df98f50d7ef062c594"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/62ffad17d53a46df98f50d7ef062c594"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/62ffad17d53a46df98f50d7ef062c594"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_62ffad17d53a46df98f50d7ef062c594", "adminURL": "http://10.222.0.16:8080"}]}] Oct 17 03:47:06.129224 dv-cinder-815582-16-smb devstack@n-api.service[110776]: X-Tenant: admin Oct 17 03:47:06.129224 dv-cinder-815582-16-smb devstack@n-api.service[110776]: X-Tenant-Id: 62ffad17d53a46df98f50d7ef062c594 Oct 17 03:47:06.129224 dv-cinder-815582-16-smb devstack@n-api.service[110776]: X-Tenant-Name: admin Oct 17 03:47:06.129224 dv-cinder-815582-16-smb devstack@n-api.service[110776]: X-User: admin Oct 17 03:47:06.129224 dv-cinder-815582-16-smb devstack@n-api.service[110776]: X-User-Domain-Id: default Oct 17 03:47:06.129224 dv-cinder-815582-16-smb devstack@n-api.service[110776]: X-User-Domain-Name: Default Oct 17 03:47:06.129224 dv-cinder-815582-16-smb devstack@n-api.service[110776]: X-User-Id: 27ce903a98a84ec7a5916b1ce85797f1 Oct 17 03:47:06.129224 dv-cinder-815582-16-smb devstack@n-api.service[110776]: X-User-Name: admin Oct 17 03:47:06.129224 dv-cinder-815582-16-smb devstack@n-api.service[110776]: method: > Oct 17 03:47:06.129224 dv-cinder-815582-16-smb devstack@n-api.service[110776]: exception: Flavor 42 could not be found. Oct 17 03:47:06.129224 dv-cinder-815582-16-smb devstack@n-api.service[110776]: action_args: {'id': '42'} Oct 17 03:47:06.129224 dv-cinder-815582-16-smb devstack@n-api.service[110776]: {{(pid=110776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:47:06.129224 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:47:06.130067 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 17 03:47:06.130067 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 17 03:47:06.130067 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 03:47:06.130067 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 03:47:06.130067 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 03:47:06.130067 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 03:47:06.130067 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 03:47:06.130067 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 03:47:06.130067 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 03:47:06.130067 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:47:06.130067 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 03:47:06.130067 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 03:47:06.130067 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 17 03:47:06.130067 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi Oct 17 03:47:06.130067 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:47:06.130067 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi Oct 17 03:47:06.130067 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:47:06.130067 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:47:06.130067 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:47:06.131840 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:47:06.131840 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:47:06.131840 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:47:06.131840 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:47:06.131840 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 17 03:47:06.131840 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:47:06.131840 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 17 03:47:06.131840 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi Oct 17 03:47:06.131840 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:47:06.131840 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi Oct 17 03:47:06.131840 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:47:06.131840 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:47:06.131840 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:47:06.131840 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:47:06.131840 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:47:06.131840 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 17 03:47:06.131840 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi Oct 17 03:47:06.131840 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi [None req-e0f62305-a9ce-4cbb-8bd2-bce5ba8302b5 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:47:06.133003 dv-cinder-815582-16-smb devstack@n-api.service[110776]: INFO nova.api.openstack.requestlog [None req-e0f62305-a9ce-4cbb-8bd2-bce5ba8302b5 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.390687 Oct 17 03:47:06.133003 dv-cinder-815582-16-smb devstack@n-api.service[110776]: [pid: 110776|app: 0|req: 19/39] 10.222.0.16 () {60 vars in 1190 bytes} [Mon Oct 17 03:47:05 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 17 03:47:06.139463 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi [None req-8effd1b3-031d-4f73-8fb1-c5dd1d787e4e admin admin] Calling method '>' {{(pid=110777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:47:06.143503 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG dbcounter [-] [110777] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=110777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:47:06.161790 dv-cinder-815582-16-smb devstack@n-api.service[110777]: INFO nova.api.openstack.requestlog [None req-8effd1b3-031d-4f73-8fb1-c5dd1d787e4e admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026079 Oct 17 03:47:06.162327 dv-cinder-815582-16-smb devstack@n-api.service[110777]: [pid: 110777|app: 0|req: 21/40] 10.222.0.16 () {60 vars in 1210 bytes} [Mon Oct 17 03:47:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:47:06.173034 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi [None req-f868c583-8d4c-4fe2-abe2-79980ec87ac7 admin admin] Calling method '>' {{(pid=110776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:47:06.195505 dv-cinder-815582-16-smb devstack@n-api.service[110776]: INFO nova.api.openstack.requestlog [None req-f868c583-8d4c-4fe2-abe2-79980ec87ac7 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027216 Oct 17 03:47:06.196039 dv-cinder-815582-16-smb devstack@n-api.service[110776]: [pid: 110776|app: 0|req: 20/41] 10.222.0.16 () {60 vars in 1210 bytes} [Mon Oct 17 03:47:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:47:06.205572 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi [None req-644017e6-9528-46a4-8b03-ed9739d5ac3e admin admin] Calling method '>' {{(pid=110777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:47:06.211198 dv-cinder-815582-16-smb devstack@n-api.service[110777]: INFO nova.api.openstack.wsgi [None req-644017e6-9528-46a4-8b03-ed9739d5ac3e admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 17 03:47:06.214460 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi [None req-644017e6-9528-46a4-8b03-ed9739d5ac3e admin admin] Request method failure captured: Oct 17 03:47:06.214460 dv-cinder-815582-16-smb devstack@n-api.service[110777]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 17 03:47:06.214460 dv-cinder-815582-16-smb devstack@n-api.service[110777]: Accept: application/json Oct 17 03:47:06.214460 dv-cinder-815582-16-smb devstack@n-api.service[110777]: Accept-Encoding: gzip, deflate Oct 17 03:47:06.214460 dv-cinder-815582-16-smb devstack@n-api.service[110777]: Connection: keep-alive Oct 17 03:47:06.214460 dv-cinder-815582-16-smb devstack@n-api.service[110777]: Content-Length: 0 Oct 17 03:47:06.214460 dv-cinder-815582-16-smb devstack@n-api.service[110777]: Host: 10.222.0.16 Oct 17 03:47:06.214460 dv-cinder-815582-16-smb devstack@n-api.service[110777]: Openstack-Api-Version: compute 2.92 Oct 17 03:47:06.214460 dv-cinder-815582-16-smb devstack@n-api.service[110777]: Openstack-System-Scope: None Oct 17 03:47:06.214460 dv-cinder-815582-16-smb devstack@n-api.service[110777]: User-Agent: python-novaclient Oct 17 03:47:06.214460 dv-cinder-815582-16-smb devstack@n-api.service[110777]: X-Auth-Token: gAAAAABjTNA561qZvAuHGNFoqj_B7r00ZAjKdRbk7ADU6Oo92_fEK-HbyxGHRMfoByFJQSThPn1Ii_QgZYvVn8y1ieo4I5mRqz6I7VX1DCd65Er2xsS0U2IDHtf76BKnJlHqRySgVSGfjE-q1OtXe41zvqZBWQz2_LonIsfR8ryIPBMRXaCNs1I Oct 17 03:47:06.214460 dv-cinder-815582-16-smb devstack@n-api.service[110777]: X-Domain-Id: None Oct 17 03:47:06.214460 dv-cinder-815582-16-smb devstack@n-api.service[110777]: X-Domain-Name: None Oct 17 03:47:06.214460 dv-cinder-815582-16-smb devstack@n-api.service[110777]: X-Identity-Status: Confirmed Oct 17 03:47:06.214460 dv-cinder-815582-16-smb devstack@n-api.service[110777]: X-Is-Admin-Project: True Oct 17 03:47:06.214460 dv-cinder-815582-16-smb devstack@n-api.service[110777]: X-Openstack-Nova-Api-Version: 2.92 Oct 17 03:47:06.214460 dv-cinder-815582-16-smb devstack@n-api.service[110777]: X-Project-Domain-Id: default Oct 17 03:47:06.214460 dv-cinder-815582-16-smb devstack@n-api.service[110777]: X-Project-Domain-Name: Default Oct 17 03:47:06.214460 dv-cinder-815582-16-smb devstack@n-api.service[110777]: X-Project-Id: 62ffad17d53a46df98f50d7ef062c594 Oct 17 03:47:06.214460 dv-cinder-815582-16-smb devstack@n-api.service[110777]: X-Project-Name: admin Oct 17 03:47:06.214460 dv-cinder-815582-16-smb devstack@n-api.service[110777]: X-Role: reader,member,admin Oct 17 03:47:06.214460 dv-cinder-815582-16-smb devstack@n-api.service[110777]: X-Roles: reader,member,admin Oct 17 03:47:06.218032 dv-cinder-815582-16-smb devstack@n-api.service[110777]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/62ffad17d53a46df98f50d7ef062c594"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/62ffad17d53a46df98f50d7ef062c594"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/62ffad17d53a46df98f50d7ef062c594"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_62ffad17d53a46df98f50d7ef062c594", "adminURL": "http://10.222.0.16:8080"}]}] Oct 17 03:47:06.218032 dv-cinder-815582-16-smb devstack@n-api.service[110777]: X-Tenant: admin Oct 17 03:47:06.218032 dv-cinder-815582-16-smb devstack@n-api.service[110777]: X-Tenant-Id: 62ffad17d53a46df98f50d7ef062c594 Oct 17 03:47:06.218032 dv-cinder-815582-16-smb devstack@n-api.service[110777]: X-Tenant-Name: admin Oct 17 03:47:06.218032 dv-cinder-815582-16-smb devstack@n-api.service[110777]: X-User: admin Oct 17 03:47:06.218032 dv-cinder-815582-16-smb devstack@n-api.service[110777]: X-User-Domain-Id: default Oct 17 03:47:06.218032 dv-cinder-815582-16-smb devstack@n-api.service[110777]: X-User-Domain-Name: Default Oct 17 03:47:06.218032 dv-cinder-815582-16-smb devstack@n-api.service[110777]: X-User-Id: 27ce903a98a84ec7a5916b1ce85797f1 Oct 17 03:47:06.218032 dv-cinder-815582-16-smb devstack@n-api.service[110777]: X-User-Name: admin Oct 17 03:47:06.218032 dv-cinder-815582-16-smb devstack@n-api.service[110777]: method: > Oct 17 03:47:06.218032 dv-cinder-815582-16-smb devstack@n-api.service[110777]: exception: Flavor 42 could not be found. Oct 17 03:47:06.218032 dv-cinder-815582-16-smb devstack@n-api.service[110777]: action_args: {'id': '42'} Oct 17 03:47:06.218032 dv-cinder-815582-16-smb devstack@n-api.service[110777]: {{(pid=110777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:47:06.218032 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:47:06.219023 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 17 03:47:06.219023 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 17 03:47:06.219023 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 03:47:06.219023 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 03:47:06.219023 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 03:47:06.219023 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 03:47:06.219023 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 03:47:06.219023 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 03:47:06.219023 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 03:47:06.219023 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:47:06.219023 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 03:47:06.219023 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 03:47:06.219023 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 17 03:47:06.219023 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi Oct 17 03:47:06.219023 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:47:06.219023 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi Oct 17 03:47:06.219023 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:47:06.219023 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:47:06.219023 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:47:06.220395 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:47:06.220395 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:47:06.220395 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:47:06.220395 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:47:06.220395 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 17 03:47:06.220395 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:47:06.220395 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 17 03:47:06.220395 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi Oct 17 03:47:06.220395 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:47:06.220395 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi Oct 17 03:47:06.220395 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:47:06.220395 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:47:06.220395 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:47:06.220395 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:47:06.220395 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:47:06.220395 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 17 03:47:06.220395 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi Oct 17 03:47:06.220395 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi [None req-644017e6-9528-46a4-8b03-ed9739d5ac3e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:47:06.221636 dv-cinder-815582-16-smb devstack@n-api.service[110777]: INFO nova.api.openstack.requestlog [None req-644017e6-9528-46a4-8b03-ed9739d5ac3e admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014098 Oct 17 03:47:06.221636 dv-cinder-815582-16-smb devstack@n-api.service[110777]: [pid: 110777|app: 0|req: 22/42] 10.222.0.16 () {60 vars in 1190 bytes} [Mon Oct 17 03:47:06 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 17 03:47:07.430959 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi [None req-f868c583-8d4c-4fe2-abe2-79980ec87ac7 admin admin] Calling method '>' {{(pid=110776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:47:07.432374 dv-cinder-815582-16-smb devstack@n-api.service[110776]: INFO nova.api.openstack.requestlog [None req-f868c583-8d4c-4fe2-abe2-79980ec87ac7 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001842 Oct 17 03:47:07.432779 dv-cinder-815582-16-smb devstack@n-api.service[110776]: [pid: 110776|app: 0|req: 21/43] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Oct 17 03:47:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:47:07.950817 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi [None req-9d206079-f6c1-406d-a1ce-d089eb7c2caa admin admin] Calling method '>' {{(pid=110777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:47:07.955864 dv-cinder-815582-16-smb devstack@n-api.service[110777]: INFO nova.api.openstack.wsgi [None req-9d206079-f6c1-406d-a1ce-d089eb7c2caa admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 17 03:47:07.957360 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi [None req-9d206079-f6c1-406d-a1ce-d089eb7c2caa admin admin] Request method failure captured: Oct 17 03:47:07.957360 dv-cinder-815582-16-smb devstack@n-api.service[110777]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 17 03:47:07.957360 dv-cinder-815582-16-smb devstack@n-api.service[110777]: Accept: application/json Oct 17 03:47:07.957360 dv-cinder-815582-16-smb devstack@n-api.service[110777]: Accept-Encoding: gzip, deflate Oct 17 03:47:07.957360 dv-cinder-815582-16-smb devstack@n-api.service[110777]: Connection: keep-alive Oct 17 03:47:07.957360 dv-cinder-815582-16-smb devstack@n-api.service[110777]: Content-Length: 0 Oct 17 03:47:07.957360 dv-cinder-815582-16-smb devstack@n-api.service[110777]: Host: 10.222.0.16 Oct 17 03:47:07.957360 dv-cinder-815582-16-smb devstack@n-api.service[110777]: Openstack-Api-Version: compute 2.92 Oct 17 03:47:07.957360 dv-cinder-815582-16-smb devstack@n-api.service[110777]: Openstack-System-Scope: None Oct 17 03:47:07.957360 dv-cinder-815582-16-smb devstack@n-api.service[110777]: User-Agent: python-novaclient Oct 17 03:47:07.957360 dv-cinder-815582-16-smb devstack@n-api.service[110777]: X-Auth-Token: gAAAAABjTNA7U2e9x7WDP8gcCpeojUYfhNYlslKt1jR3S92171FeBzHRYUAzRzzP4Ml2ZO4L7eSUZM5p9o3L16_pe6PGAA5OeSRgD1tY3s3q03xni24s3U5jwlDta5p5zYOuy4Pl62JIfd-J0zut01kTmaSQW0zlL6whZRcIVXXYtQA9v9-4aSs Oct 17 03:47:07.957360 dv-cinder-815582-16-smb devstack@n-api.service[110777]: X-Domain-Id: None Oct 17 03:47:07.957360 dv-cinder-815582-16-smb devstack@n-api.service[110777]: X-Domain-Name: None Oct 17 03:47:07.957360 dv-cinder-815582-16-smb devstack@n-api.service[110777]: X-Identity-Status: Confirmed Oct 17 03:47:07.957360 dv-cinder-815582-16-smb devstack@n-api.service[110777]: X-Is-Admin-Project: True Oct 17 03:47:07.957360 dv-cinder-815582-16-smb devstack@n-api.service[110777]: X-Openstack-Nova-Api-Version: 2.92 Oct 17 03:47:07.957360 dv-cinder-815582-16-smb devstack@n-api.service[110777]: X-Project-Domain-Id: default Oct 17 03:47:07.957360 dv-cinder-815582-16-smb devstack@n-api.service[110777]: X-Project-Domain-Name: Default Oct 17 03:47:07.957360 dv-cinder-815582-16-smb devstack@n-api.service[110777]: X-Project-Id: 62ffad17d53a46df98f50d7ef062c594 Oct 17 03:47:07.957360 dv-cinder-815582-16-smb devstack@n-api.service[110777]: X-Project-Name: admin Oct 17 03:47:07.957360 dv-cinder-815582-16-smb devstack@n-api.service[110777]: X-Role: reader,member,admin Oct 17 03:47:07.957360 dv-cinder-815582-16-smb devstack@n-api.service[110777]: X-Roles: reader,member,admin Oct 17 03:47:07.958952 dv-cinder-815582-16-smb devstack@n-api.service[110777]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/62ffad17d53a46df98f50d7ef062c594"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/62ffad17d53a46df98f50d7ef062c594"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/62ffad17d53a46df98f50d7ef062c594"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_62ffad17d53a46df98f50d7ef062c594", "adminURL": "http://10.222.0.16:8080"}]}] Oct 17 03:47:07.958952 dv-cinder-815582-16-smb devstack@n-api.service[110777]: X-Tenant: admin Oct 17 03:47:07.958952 dv-cinder-815582-16-smb devstack@n-api.service[110777]: X-Tenant-Id: 62ffad17d53a46df98f50d7ef062c594 Oct 17 03:47:07.958952 dv-cinder-815582-16-smb devstack@n-api.service[110777]: X-Tenant-Name: admin Oct 17 03:47:07.958952 dv-cinder-815582-16-smb devstack@n-api.service[110777]: X-User: admin Oct 17 03:47:07.958952 dv-cinder-815582-16-smb devstack@n-api.service[110777]: X-User-Domain-Id: default Oct 17 03:47:07.958952 dv-cinder-815582-16-smb devstack@n-api.service[110777]: X-User-Domain-Name: Default Oct 17 03:47:07.958952 dv-cinder-815582-16-smb devstack@n-api.service[110777]: X-User-Id: 27ce903a98a84ec7a5916b1ce85797f1 Oct 17 03:47:07.958952 dv-cinder-815582-16-smb devstack@n-api.service[110777]: X-User-Name: admin Oct 17 03:47:07.958952 dv-cinder-815582-16-smb devstack@n-api.service[110777]: method: > Oct 17 03:47:07.958952 dv-cinder-815582-16-smb devstack@n-api.service[110777]: exception: Flavor 84 could not be found. Oct 17 03:47:07.958952 dv-cinder-815582-16-smb devstack@n-api.service[110777]: action_args: {'id': '84'} Oct 17 03:47:07.958952 dv-cinder-815582-16-smb devstack@n-api.service[110777]: {{(pid=110777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:47:07.958952 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:47:07.960042 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 17 03:47:07.960042 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 17 03:47:07.960042 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 03:47:07.960042 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 03:47:07.960042 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 03:47:07.960042 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 03:47:07.960042 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 03:47:07.960042 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 03:47:07.960042 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 03:47:07.960042 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:47:07.960042 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 03:47:07.960042 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 03:47:07.960042 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 17 03:47:07.960042 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi Oct 17 03:47:07.960042 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:47:07.960042 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi Oct 17 03:47:07.960042 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:47:07.960042 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:47:07.960042 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:47:07.961441 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:47:07.961441 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:47:07.961441 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:47:07.961441 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:47:07.961441 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 17 03:47:07.961441 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:47:07.961441 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 17 03:47:07.961441 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi Oct 17 03:47:07.961441 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:47:07.961441 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi Oct 17 03:47:07.961441 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:47:07.961441 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:47:07.961441 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:47:07.961441 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:47:07.961441 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:47:07.961441 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 17 03:47:07.961441 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi Oct 17 03:47:07.961441 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi [None req-9d206079-f6c1-406d-a1ce-d089eb7c2caa admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:47:07.962705 dv-cinder-815582-16-smb devstack@n-api.service[110777]: INFO nova.api.openstack.requestlog [None req-9d206079-f6c1-406d-a1ce-d089eb7c2caa admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.386313 Oct 17 03:47:07.962705 dv-cinder-815582-16-smb devstack@n-api.service[110777]: [pid: 110777|app: 0|req: 23/44] 10.222.0.16 () {60 vars in 1190 bytes} [Mon Oct 17 03:47:07 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 387 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 17 03:47:07.968694 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi [None req-4cdf7dfe-09f5-4b50-8d61-ad85ca3cf59f admin admin] Calling method '>' {{(pid=110776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:47:07.984242 dv-cinder-815582-16-smb devstack@n-api.service[110776]: INFO nova.api.openstack.requestlog [None req-4cdf7dfe-09f5-4b50-8d61-ad85ca3cf59f admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019320 Oct 17 03:47:07.984773 dv-cinder-815582-16-smb devstack@n-api.service[110776]: [pid: 110776|app: 0|req: 22/45] 10.222.0.16 () {60 vars in 1210 bytes} [Mon Oct 17 03:47:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:47:07.994740 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi [None req-f5f1c971-7442-43d4-9713-0fdf759089ee admin admin] Calling method '>' {{(pid=110777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:47:08.010039 dv-cinder-815582-16-smb devstack@n-api.service[110777]: INFO nova.api.openstack.requestlog [None req-f5f1c971-7442-43d4-9713-0fdf759089ee admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018808 Oct 17 03:47:08.010570 dv-cinder-815582-16-smb devstack@n-api.service[110777]: [pid: 110777|app: 0|req: 24/46] 10.222.0.16 () {60 vars in 1210 bytes} [Mon Oct 17 03:47:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:47:08.019936 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi [None req-85836c43-4fb8-4f55-ad7d-bb198b6ea50a admin admin] Calling method '>' {{(pid=110776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:47:08.024853 dv-cinder-815582-16-smb devstack@n-api.service[110776]: INFO nova.api.openstack.wsgi [None req-85836c43-4fb8-4f55-ad7d-bb198b6ea50a admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 17 03:47:08.026341 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi [None req-85836c43-4fb8-4f55-ad7d-bb198b6ea50a admin admin] Request method failure captured: Oct 17 03:47:08.026341 dv-cinder-815582-16-smb devstack@n-api.service[110776]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 17 03:47:08.026341 dv-cinder-815582-16-smb devstack@n-api.service[110776]: Accept: application/json Oct 17 03:47:08.026341 dv-cinder-815582-16-smb devstack@n-api.service[110776]: Accept-Encoding: gzip, deflate Oct 17 03:47:08.026341 dv-cinder-815582-16-smb devstack@n-api.service[110776]: Connection: keep-alive Oct 17 03:47:08.026341 dv-cinder-815582-16-smb devstack@n-api.service[110776]: Content-Length: 0 Oct 17 03:47:08.026341 dv-cinder-815582-16-smb devstack@n-api.service[110776]: Host: 10.222.0.16 Oct 17 03:47:08.026341 dv-cinder-815582-16-smb devstack@n-api.service[110776]: Openstack-Api-Version: compute 2.92 Oct 17 03:47:08.026341 dv-cinder-815582-16-smb devstack@n-api.service[110776]: Openstack-System-Scope: None Oct 17 03:47:08.026341 dv-cinder-815582-16-smb devstack@n-api.service[110776]: User-Agent: python-novaclient Oct 17 03:47:08.026341 dv-cinder-815582-16-smb devstack@n-api.service[110776]: X-Auth-Token: gAAAAABjTNA7U2e9x7WDP8gcCpeojUYfhNYlslKt1jR3S92171FeBzHRYUAzRzzP4Ml2ZO4L7eSUZM5p9o3L16_pe6PGAA5OeSRgD1tY3s3q03xni24s3U5jwlDta5p5zYOuy4Pl62JIfd-J0zut01kTmaSQW0zlL6whZRcIVXXYtQA9v9-4aSs Oct 17 03:47:08.026341 dv-cinder-815582-16-smb devstack@n-api.service[110776]: X-Domain-Id: None Oct 17 03:47:08.026341 dv-cinder-815582-16-smb devstack@n-api.service[110776]: X-Domain-Name: None Oct 17 03:47:08.026341 dv-cinder-815582-16-smb devstack@n-api.service[110776]: X-Identity-Status: Confirmed Oct 17 03:47:08.026341 dv-cinder-815582-16-smb devstack@n-api.service[110776]: X-Is-Admin-Project: True Oct 17 03:47:08.026341 dv-cinder-815582-16-smb devstack@n-api.service[110776]: X-Openstack-Nova-Api-Version: 2.92 Oct 17 03:47:08.026341 dv-cinder-815582-16-smb devstack@n-api.service[110776]: X-Project-Domain-Id: default Oct 17 03:47:08.026341 dv-cinder-815582-16-smb devstack@n-api.service[110776]: X-Project-Domain-Name: Default Oct 17 03:47:08.026341 dv-cinder-815582-16-smb devstack@n-api.service[110776]: X-Project-Id: 62ffad17d53a46df98f50d7ef062c594 Oct 17 03:47:08.026341 dv-cinder-815582-16-smb devstack@n-api.service[110776]: X-Project-Name: admin Oct 17 03:47:08.026341 dv-cinder-815582-16-smb devstack@n-api.service[110776]: X-Role: reader,member,admin Oct 17 03:47:08.026341 dv-cinder-815582-16-smb devstack@n-api.service[110776]: X-Roles: reader,member,admin Oct 17 03:47:08.027900 dv-cinder-815582-16-smb devstack@n-api.service[110776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/62ffad17d53a46df98f50d7ef062c594"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/62ffad17d53a46df98f50d7ef062c594"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/62ffad17d53a46df98f50d7ef062c594"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_62ffad17d53a46df98f50d7ef062c594", "adminURL": "http://10.222.0.16:8080"}]}] Oct 17 03:47:08.027900 dv-cinder-815582-16-smb devstack@n-api.service[110776]: X-Tenant: admin Oct 17 03:47:08.027900 dv-cinder-815582-16-smb devstack@n-api.service[110776]: X-Tenant-Id: 62ffad17d53a46df98f50d7ef062c594 Oct 17 03:47:08.027900 dv-cinder-815582-16-smb devstack@n-api.service[110776]: X-Tenant-Name: admin Oct 17 03:47:08.027900 dv-cinder-815582-16-smb devstack@n-api.service[110776]: X-User: admin Oct 17 03:47:08.027900 dv-cinder-815582-16-smb devstack@n-api.service[110776]: X-User-Domain-Id: default Oct 17 03:47:08.027900 dv-cinder-815582-16-smb devstack@n-api.service[110776]: X-User-Domain-Name: Default Oct 17 03:47:08.027900 dv-cinder-815582-16-smb devstack@n-api.service[110776]: X-User-Id: 27ce903a98a84ec7a5916b1ce85797f1 Oct 17 03:47:08.027900 dv-cinder-815582-16-smb devstack@n-api.service[110776]: X-User-Name: admin Oct 17 03:47:08.027900 dv-cinder-815582-16-smb devstack@n-api.service[110776]: method: > Oct 17 03:47:08.027900 dv-cinder-815582-16-smb devstack@n-api.service[110776]: exception: Flavor 84 could not be found. Oct 17 03:47:08.027900 dv-cinder-815582-16-smb devstack@n-api.service[110776]: action_args: {'id': '84'} Oct 17 03:47:08.027900 dv-cinder-815582-16-smb devstack@n-api.service[110776]: {{(pid=110776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:47:08.027900 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:47:08.028937 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 17 03:47:08.028937 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 17 03:47:08.028937 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 03:47:08.028937 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 03:47:08.028937 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 03:47:08.028937 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 03:47:08.028937 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 03:47:08.028937 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 03:47:08.028937 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 03:47:08.028937 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:47:08.028937 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 03:47:08.028937 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 03:47:08.028937 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 17 03:47:08.028937 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi Oct 17 03:47:08.028937 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:47:08.028937 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi Oct 17 03:47:08.028937 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:47:08.028937 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:47:08.028937 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:47:08.030256 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:47:08.030256 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:47:08.030256 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:47:08.030256 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:47:08.030256 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 17 03:47:08.030256 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:47:08.030256 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 17 03:47:08.030256 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi Oct 17 03:47:08.030256 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:47:08.030256 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi Oct 17 03:47:08.030256 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:47:08.030256 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:47:08.030256 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:47:08.030256 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:47:08.030256 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:47:08.030256 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 17 03:47:08.030256 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi Oct 17 03:47:08.030256 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi [None req-85836c43-4fb8-4f55-ad7d-bb198b6ea50a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:47:08.031518 dv-cinder-815582-16-smb devstack@n-api.service[110776]: INFO nova.api.openstack.requestlog [None req-85836c43-4fb8-4f55-ad7d-bb198b6ea50a admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011646 Oct 17 03:47:08.031518 dv-cinder-815582-16-smb devstack@n-api.service[110776]: [pid: 110776|app: 0|req: 23/47] 10.222.0.16 () {60 vars in 1190 bytes} [Mon Oct 17 03:47:08 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 17 03:47:09.238858 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi [None req-f5f1c971-7442-43d4-9713-0fdf759089ee admin admin] Calling method '>' {{(pid=110777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:47:09.240443 dv-cinder-815582-16-smb devstack@n-api.service[110777]: INFO nova.api.openstack.requestlog [None req-f5f1c971-7442-43d4-9713-0fdf759089ee admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Oct 17 03:47:09.240810 dv-cinder-815582-16-smb devstack@n-api.service[110777]: [pid: 110777|app: 0|req: 25/48] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Oct 17 03:47:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:47:09.760568 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi [None req-7bbdd1a0-40d4-47ae-8856-cd661c893132 admin admin] Calling method '>' {{(pid=110776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:47:09.766679 dv-cinder-815582-16-smb devstack@n-api.service[110776]: INFO nova.api.openstack.wsgi [None req-7bbdd1a0-40d4-47ae-8856-cd661c893132 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 17 03:47:09.768198 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi [None req-7bbdd1a0-40d4-47ae-8856-cd661c893132 admin admin] Request method failure captured: Oct 17 03:47:09.768198 dv-cinder-815582-16-smb devstack@n-api.service[110776]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 17 03:47:09.768198 dv-cinder-815582-16-smb devstack@n-api.service[110776]: Accept: application/json Oct 17 03:47:09.768198 dv-cinder-815582-16-smb devstack@n-api.service[110776]: Accept-Encoding: gzip, deflate Oct 17 03:47:09.768198 dv-cinder-815582-16-smb devstack@n-api.service[110776]: Connection: keep-alive Oct 17 03:47:09.768198 dv-cinder-815582-16-smb devstack@n-api.service[110776]: Content-Length: 0 Oct 17 03:47:09.768198 dv-cinder-815582-16-smb devstack@n-api.service[110776]: Host: 10.222.0.16 Oct 17 03:47:09.768198 dv-cinder-815582-16-smb devstack@n-api.service[110776]: Openstack-Api-Version: compute 2.92 Oct 17 03:47:09.768198 dv-cinder-815582-16-smb devstack@n-api.service[110776]: Openstack-System-Scope: None Oct 17 03:47:09.768198 dv-cinder-815582-16-smb devstack@n-api.service[110776]: User-Agent: python-novaclient Oct 17 03:47:09.768198 dv-cinder-815582-16-smb devstack@n-api.service[110776]: X-Auth-Token: gAAAAABjTNA9hJouncioBjjz09796TynvdayrIbdnEYJytjm3178mmL6JsM5pvKjIe87rDqWtXp5rBEUbHe6rVGU2qfwypSzZHa-2VYt7Z0Y-Qg5FOyaaR6R4lzPh-2Bd6gEHyRcAM0CRKMcMVk0GmP8UMcRomDkuV9o3_8tjhEerbEkASbqwfY Oct 17 03:47:09.768198 dv-cinder-815582-16-smb devstack@n-api.service[110776]: X-Domain-Id: None Oct 17 03:47:09.768198 dv-cinder-815582-16-smb devstack@n-api.service[110776]: X-Domain-Name: None Oct 17 03:47:09.768198 dv-cinder-815582-16-smb devstack@n-api.service[110776]: X-Identity-Status: Confirmed Oct 17 03:47:09.768198 dv-cinder-815582-16-smb devstack@n-api.service[110776]: X-Is-Admin-Project: True Oct 17 03:47:09.768198 dv-cinder-815582-16-smb devstack@n-api.service[110776]: X-Openstack-Nova-Api-Version: 2.92 Oct 17 03:47:09.768198 dv-cinder-815582-16-smb devstack@n-api.service[110776]: X-Project-Domain-Id: default Oct 17 03:47:09.768198 dv-cinder-815582-16-smb devstack@n-api.service[110776]: X-Project-Domain-Name: Default Oct 17 03:47:09.768198 dv-cinder-815582-16-smb devstack@n-api.service[110776]: X-Project-Id: 62ffad17d53a46df98f50d7ef062c594 Oct 17 03:47:09.768198 dv-cinder-815582-16-smb devstack@n-api.service[110776]: X-Project-Name: admin Oct 17 03:47:09.768198 dv-cinder-815582-16-smb devstack@n-api.service[110776]: X-Role: reader,member,admin Oct 17 03:47:09.768198 dv-cinder-815582-16-smb devstack@n-api.service[110776]: X-Roles: reader,member,admin Oct 17 03:47:09.769818 dv-cinder-815582-16-smb devstack@n-api.service[110776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/62ffad17d53a46df98f50d7ef062c594"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/62ffad17d53a46df98f50d7ef062c594"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/62ffad17d53a46df98f50d7ef062c594"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_62ffad17d53a46df98f50d7ef062c594", "adminURL": "http://10.222.0.16:8080"}]}] Oct 17 03:47:09.769818 dv-cinder-815582-16-smb devstack@n-api.service[110776]: X-Tenant: admin Oct 17 03:47:09.769818 dv-cinder-815582-16-smb devstack@n-api.service[110776]: X-Tenant-Id: 62ffad17d53a46df98f50d7ef062c594 Oct 17 03:47:09.769818 dv-cinder-815582-16-smb devstack@n-api.service[110776]: X-Tenant-Name: admin Oct 17 03:47:09.769818 dv-cinder-815582-16-smb devstack@n-api.service[110776]: X-User: admin Oct 17 03:47:09.769818 dv-cinder-815582-16-smb devstack@n-api.service[110776]: X-User-Domain-Id: default Oct 17 03:47:09.769818 dv-cinder-815582-16-smb devstack@n-api.service[110776]: X-User-Domain-Name: Default Oct 17 03:47:09.769818 dv-cinder-815582-16-smb devstack@n-api.service[110776]: X-User-Id: 27ce903a98a84ec7a5916b1ce85797f1 Oct 17 03:47:09.769818 dv-cinder-815582-16-smb devstack@n-api.service[110776]: X-User-Name: admin Oct 17 03:47:09.769818 dv-cinder-815582-16-smb devstack@n-api.service[110776]: method: > Oct 17 03:47:09.769818 dv-cinder-815582-16-smb devstack@n-api.service[110776]: exception: Flavor 451 could not be found. Oct 17 03:47:09.769818 dv-cinder-815582-16-smb devstack@n-api.service[110776]: action_args: {'id': '451'} Oct 17 03:47:09.769818 dv-cinder-815582-16-smb devstack@n-api.service[110776]: {{(pid=110776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:47:09.769818 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:47:09.775853 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 17 03:47:09.775853 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 17 03:47:09.775853 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 03:47:09.775853 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 03:47:09.775853 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 03:47:09.775853 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 03:47:09.775853 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 03:47:09.775853 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 03:47:09.775853 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 03:47:09.775853 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:47:09.775853 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 03:47:09.775853 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 03:47:09.775853 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 17 03:47:09.775853 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi Oct 17 03:47:09.775853 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:47:09.775853 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi Oct 17 03:47:09.775853 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:47:09.775853 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:47:09.775853 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:47:09.777202 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:47:09.777202 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:47:09.777202 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:47:09.777202 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:47:09.777202 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 17 03:47:09.777202 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:47:09.777202 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 17 03:47:09.777202 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi Oct 17 03:47:09.777202 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:47:09.777202 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi Oct 17 03:47:09.777202 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:47:09.777202 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:47:09.777202 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:47:09.777202 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:47:09.777202 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:47:09.777202 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 17 03:47:09.777202 dv-cinder-815582-16-smb devstack@n-api.service[110776]: ERROR nova.api.openstack.wsgi Oct 17 03:47:09.777202 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi [None req-7bbdd1a0-40d4-47ae-8856-cd661c893132 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:47:09.778486 dv-cinder-815582-16-smb devstack@n-api.service[110776]: INFO nova.api.openstack.requestlog [None req-7bbdd1a0-40d4-47ae-8856-cd661c893132 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.393225 Oct 17 03:47:09.778486 dv-cinder-815582-16-smb devstack@n-api.service[110776]: [pid: 110776|app: 0|req: 24/49] 10.222.0.16 () {60 vars in 1193 bytes} [Mon Oct 17 03:47:09 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 17 03:47:09.779854 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi [None req-a35143a6-eeee-4cdb-ab9e-57904e040133 admin admin] Calling method '>' {{(pid=110777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:47:09.795182 dv-cinder-815582-16-smb devstack@n-api.service[110777]: INFO nova.api.openstack.requestlog [None req-a35143a6-eeee-4cdb-ab9e-57904e040133 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018855 Oct 17 03:47:09.795710 dv-cinder-815582-16-smb devstack@n-api.service[110777]: [pid: 110777|app: 0|req: 26/50] 10.222.0.16 () {60 vars in 1210 bytes} [Mon Oct 17 03:47:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:47:09.804668 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi [None req-120ddc90-c96e-42bd-913e-3a2787a12715 admin admin] Calling method '>' {{(pid=110776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:47:09.819041 dv-cinder-815582-16-smb devstack@n-api.service[110776]: INFO nova.api.openstack.requestlog [None req-120ddc90-c96e-42bd-913e-3a2787a12715 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.017792 Oct 17 03:47:09.819585 dv-cinder-815582-16-smb devstack@n-api.service[110776]: [pid: 110776|app: 0|req: 25/51] 10.222.0.16 () {60 vars in 1210 bytes} [Mon Oct 17 03:47:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:47:09.828408 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi [None req-74f1b060-f324-4f62-8fab-24693b19ab4a admin admin] Calling method '>' {{(pid=110777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:47:09.833261 dv-cinder-815582-16-smb devstack@n-api.service[110777]: INFO nova.api.openstack.wsgi [None req-74f1b060-f324-4f62-8fab-24693b19ab4a admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 17 03:47:09.835275 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi [None req-74f1b060-f324-4f62-8fab-24693b19ab4a admin admin] Request method failure captured: Oct 17 03:47:09.835275 dv-cinder-815582-16-smb devstack@n-api.service[110777]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 17 03:47:09.835275 dv-cinder-815582-16-smb devstack@n-api.service[110777]: Accept: application/json Oct 17 03:47:09.835275 dv-cinder-815582-16-smb devstack@n-api.service[110777]: Accept-Encoding: gzip, deflate Oct 17 03:47:09.835275 dv-cinder-815582-16-smb devstack@n-api.service[110777]: Connection: keep-alive Oct 17 03:47:09.835275 dv-cinder-815582-16-smb devstack@n-api.service[110777]: Content-Length: 0 Oct 17 03:47:09.835275 dv-cinder-815582-16-smb devstack@n-api.service[110777]: Host: 10.222.0.16 Oct 17 03:47:09.835275 dv-cinder-815582-16-smb devstack@n-api.service[110777]: Openstack-Api-Version: compute 2.92 Oct 17 03:47:09.835275 dv-cinder-815582-16-smb devstack@n-api.service[110777]: Openstack-System-Scope: None Oct 17 03:47:09.835275 dv-cinder-815582-16-smb devstack@n-api.service[110777]: User-Agent: python-novaclient Oct 17 03:47:09.835275 dv-cinder-815582-16-smb devstack@n-api.service[110777]: X-Auth-Token: gAAAAABjTNA9hJouncioBjjz09796TynvdayrIbdnEYJytjm3178mmL6JsM5pvKjIe87rDqWtXp5rBEUbHe6rVGU2qfwypSzZHa-2VYt7Z0Y-Qg5FOyaaR6R4lzPh-2Bd6gEHyRcAM0CRKMcMVk0GmP8UMcRomDkuV9o3_8tjhEerbEkASbqwfY Oct 17 03:47:09.835275 dv-cinder-815582-16-smb devstack@n-api.service[110777]: X-Domain-Id: None Oct 17 03:47:09.835275 dv-cinder-815582-16-smb devstack@n-api.service[110777]: X-Domain-Name: None Oct 17 03:47:09.835275 dv-cinder-815582-16-smb devstack@n-api.service[110777]: X-Identity-Status: Confirmed Oct 17 03:47:09.835275 dv-cinder-815582-16-smb devstack@n-api.service[110777]: X-Is-Admin-Project: True Oct 17 03:47:09.835275 dv-cinder-815582-16-smb devstack@n-api.service[110777]: X-Openstack-Nova-Api-Version: 2.92 Oct 17 03:47:09.835275 dv-cinder-815582-16-smb devstack@n-api.service[110777]: X-Project-Domain-Id: default Oct 17 03:47:09.835275 dv-cinder-815582-16-smb devstack@n-api.service[110777]: X-Project-Domain-Name: Default Oct 17 03:47:09.835275 dv-cinder-815582-16-smb devstack@n-api.service[110777]: X-Project-Id: 62ffad17d53a46df98f50d7ef062c594 Oct 17 03:47:09.835275 dv-cinder-815582-16-smb devstack@n-api.service[110777]: X-Project-Name: admin Oct 17 03:47:09.835275 dv-cinder-815582-16-smb devstack@n-api.service[110777]: X-Role: reader,member,admin Oct 17 03:47:09.835275 dv-cinder-815582-16-smb devstack@n-api.service[110777]: X-Roles: reader,member,admin Oct 17 03:47:09.836854 dv-cinder-815582-16-smb devstack@n-api.service[110777]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/62ffad17d53a46df98f50d7ef062c594"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/62ffad17d53a46df98f50d7ef062c594"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/62ffad17d53a46df98f50d7ef062c594"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_62ffad17d53a46df98f50d7ef062c594", "adminURL": "http://10.222.0.16:8080"}]}] Oct 17 03:47:09.836854 dv-cinder-815582-16-smb devstack@n-api.service[110777]: X-Tenant: admin Oct 17 03:47:09.836854 dv-cinder-815582-16-smb devstack@n-api.service[110777]: X-Tenant-Id: 62ffad17d53a46df98f50d7ef062c594 Oct 17 03:47:09.836854 dv-cinder-815582-16-smb devstack@n-api.service[110777]: X-Tenant-Name: admin Oct 17 03:47:09.836854 dv-cinder-815582-16-smb devstack@n-api.service[110777]: X-User: admin Oct 17 03:47:09.836854 dv-cinder-815582-16-smb devstack@n-api.service[110777]: X-User-Domain-Id: default Oct 17 03:47:09.836854 dv-cinder-815582-16-smb devstack@n-api.service[110777]: X-User-Domain-Name: Default Oct 17 03:47:09.836854 dv-cinder-815582-16-smb devstack@n-api.service[110777]: X-User-Id: 27ce903a98a84ec7a5916b1ce85797f1 Oct 17 03:47:09.836854 dv-cinder-815582-16-smb devstack@n-api.service[110777]: X-User-Name: admin Oct 17 03:47:09.836854 dv-cinder-815582-16-smb devstack@n-api.service[110777]: method: > Oct 17 03:47:09.836854 dv-cinder-815582-16-smb devstack@n-api.service[110777]: exception: Flavor 451 could not be found. Oct 17 03:47:09.836854 dv-cinder-815582-16-smb devstack@n-api.service[110777]: action_args: {'id': '451'} Oct 17 03:47:09.836854 dv-cinder-815582-16-smb devstack@n-api.service[110777]: {{(pid=110777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:47:09.836854 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:47:09.838018 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 17 03:47:09.838018 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 17 03:47:09.838018 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 03:47:09.838018 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 03:47:09.838018 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 03:47:09.838018 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 03:47:09.838018 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 03:47:09.838018 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 03:47:09.838018 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 03:47:09.838018 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:47:09.838018 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 03:47:09.838018 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 03:47:09.838018 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 17 03:47:09.838018 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi Oct 17 03:47:09.838018 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:47:09.838018 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi Oct 17 03:47:09.838018 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:47:09.838018 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:47:09.838018 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:47:09.839348 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:47:09.839348 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:47:09.839348 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:47:09.839348 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:47:09.839348 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 17 03:47:09.839348 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:47:09.839348 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 17 03:47:09.839348 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi Oct 17 03:47:09.839348 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:47:09.839348 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi Oct 17 03:47:09.839348 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:47:09.839348 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:47:09.839348 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:47:09.839348 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:47:09.839348 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:47:09.839348 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 17 03:47:09.839348 dv-cinder-815582-16-smb devstack@n-api.service[110777]: ERROR nova.api.openstack.wsgi Oct 17 03:47:09.839348 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi [None req-74f1b060-f324-4f62-8fab-24693b19ab4a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:47:09.840612 dv-cinder-815582-16-smb devstack@n-api.service[110777]: INFO nova.api.openstack.requestlog [None req-74f1b060-f324-4f62-8fab-24693b19ab4a admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011554 Oct 17 03:47:09.840612 dv-cinder-815582-16-smb devstack@n-api.service[110777]: [pid: 110777|app: 0|req: 27/52] 10.222.0.16 () {60 vars in 1193 bytes} [Mon Oct 17 03:47:09 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 17 03:47:11.053983 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi [None req-120ddc90-c96e-42bd-913e-3a2787a12715 admin admin] Calling method '>' {{(pid=110776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:47:11.055430 dv-cinder-815582-16-smb devstack@n-api.service[110776]: INFO nova.api.openstack.requestlog [None req-120ddc90-c96e-42bd-913e-3a2787a12715 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003039 Oct 17 03:47:11.056073 dv-cinder-815582-16-smb devstack@n-api.service[110776]: [pid: 110776|app: 0|req: 26/53] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Oct 17 03:47:11 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:47:11.574164 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi [None req-1c85a588-11e7-478d-9a62-95834f0efe64 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:47:11.672289 dv-cinder-815582-16-smb devstack@n-api.service[110777]: INFO nova.api.openstack.requestlog [None req-1c85a588-11e7-478d-9a62-95834f0efe64 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.474900 Oct 17 03:47:11.672761 dv-cinder-815582-16-smb devstack@n-api.service[110777]: [pid: 110777|app: 0|req: 28/54] 10.222.0.16 () {64 vars in 1235 bytes} [Mon Oct 17 03:47:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 03:47:12.884742 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi [None req-120ddc90-c96e-42bd-913e-3a2787a12715 admin admin] Calling method '>' {{(pid=110776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:47:12.885740 dv-cinder-815582-16-smb devstack@n-api.service[110776]: INFO nova.api.openstack.requestlog [None req-120ddc90-c96e-42bd-913e-3a2787a12715 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Oct 17 03:47:12.886160 dv-cinder-815582-16-smb devstack@n-api.service[110776]: [pid: 110776|app: 0|req: 27/55] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Oct 17 03:47:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:47:13.403839 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi [None req-351c13a4-b4a6-46a9-9a4c-8ddc8e9ab35c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:47:13.476906 dv-cinder-815582-16-smb devstack@n-api.service[110777]: INFO nova.api.openstack.requestlog [None req-351c13a4-b4a6-46a9-9a4c-8ddc8e9ab35c admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.450412 Oct 17 03:47:13.477452 dv-cinder-815582-16-smb devstack@n-api.service[110777]: [pid: 110777|app: 0|req: 29/56] 10.222.0.16 () {64 vars in 1235 bytes} [Mon Oct 17 03:47:13 2022] POST /compute/v2.1/flavors => generated 405 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 03:47:14.688493 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi [None req-120ddc90-c96e-42bd-913e-3a2787a12715 admin admin] Calling method '>' {{(pid=110776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:47:14.689502 dv-cinder-815582-16-smb devstack@n-api.service[110776]: INFO nova.api.openstack.requestlog [None req-120ddc90-c96e-42bd-913e-3a2787a12715 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Oct 17 03:47:14.689893 dv-cinder-815582-16-smb devstack@n-api.service[110776]: [pid: 110776|app: 0|req: 28/57] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Oct 17 03:47:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:47:15.219043 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi [None req-27aead96-1701-408b-8253-177b0d51e879 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:47:15.317491 dv-cinder-815582-16-smb devstack@n-api.service[110777]: INFO nova.api.openstack.requestlog [None req-27aead96-1701-408b-8253-177b0d51e879 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.489212 Oct 17 03:47:15.318679 dv-cinder-815582-16-smb devstack@n-api.service[110777]: [pid: 110777|app: 0|req: 30/58] 10.222.0.16 () {64 vars in 1235 bytes} [Mon Oct 17 03:47:14 2022] POST /compute/v2.1/flavors => generated 407 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 03:47:16.527608 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi [None req-120ddc90-c96e-42bd-913e-3a2787a12715 admin admin] Calling method '>' {{(pid=110776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:47:16.528616 dv-cinder-815582-16-smb devstack@n-api.service[110776]: INFO nova.api.openstack.requestlog [None req-120ddc90-c96e-42bd-913e-3a2787a12715 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Oct 17 03:47:16.529038 dv-cinder-815582-16-smb devstack@n-api.service[110776]: [pid: 110776|app: 0|req: 29/59] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Oct 17 03:47:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:47:17.051021 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi [None req-9679f515-99ce-4879-9562-c25cc1e556c3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:47:17.105931 dv-cinder-815582-16-smb devstack@n-api.service[110777]: INFO nova.api.openstack.requestlog [None req-9679f515-99ce-4879-9562-c25cc1e556c3 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.438910 Oct 17 03:47:17.106489 dv-cinder-815582-16-smb devstack@n-api.service[110777]: [pid: 110777|app: 0|req: 31/60] 10.222.0.16 () {64 vars in 1235 bytes} [Mon Oct 17 03:47:16 2022] POST /compute/v2.1/flavors => generated 409 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 03:47:18.318445 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi [None req-120ddc90-c96e-42bd-913e-3a2787a12715 admin admin] Calling method '>' {{(pid=110776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:47:18.319483 dv-cinder-815582-16-smb devstack@n-api.service[110776]: INFO nova.api.openstack.requestlog [None req-120ddc90-c96e-42bd-913e-3a2787a12715 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001977 Oct 17 03:47:18.319876 dv-cinder-815582-16-smb devstack@n-api.service[110776]: [pid: 110776|app: 0|req: 30/61] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Oct 17 03:47:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:47:18.834973 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi [None req-2b8ddfd8-4210-4e00-9197-9df9a84eacdf admin admin] Calling method '>' {{(pid=110777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:47:18.855493 dv-cinder-815582-16-smb devstack@n-api.service[110777]: INFO nova.api.openstack.requestlog [None req-2b8ddfd8-4210-4e00-9197-9df9a84eacdf admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.399361 Oct 17 03:47:18.856031 dv-cinder-815582-16-smb devstack@n-api.service[110777]: [pid: 110777|app: 0|req: 32/62] 10.222.0.16 () {60 vars in 1202 bytes} [Mon Oct 17 03:47:18 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:48:15.114899 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi [None req-120ddc90-c96e-42bd-913e-3a2787a12715 admin admin] Calling method '>' {{(pid=110776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:48:15.115948 dv-cinder-815582-16-smb devstack@n-api.service[110776]: INFO nova.api.openstack.requestlog [None req-120ddc90-c96e-42bd-913e-3a2787a12715 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Oct 17 03:48:15.116339 dv-cinder-815582-16-smb devstack@n-api.service[110776]: [pid: 110776|app: 0|req: 31/63] 10.222.0.16 () {54 vars in 931 bytes} [Mon Oct 17 03:48:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:48:15.126857 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG dbcounter [-] [110777] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=110777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:48:15.505024 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi [None req-a492d15e-541b-43f3-86f9-7a6349eb9c91 admin admin] Calling method '>' {{(pid=110777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:48:15.525455 dv-cinder-815582-16-smb devstack@n-api.service[110777]: INFO nova.api.openstack.requestlog [None req-a492d15e-541b-43f3-86f9-7a6349eb9c91 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.403085 Oct 17 03:48:15.526000 dv-cinder-815582-16-smb devstack@n-api.service[110777]: [pid: 110777|app: 0|req: 33/64] 10.222.0.16 () {60 vars in 1292 bytes} [Mon Oct 17 03:48:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:48:15.547520 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG dbcounter [-] [110776] Writing DB stats nova_api:SELECT=14 {{(pid=110776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:48:15.551820 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi [None req-31dce05b-6f82-4f32-b609-7d71b7159fde admin admin] Calling method '>' {{(pid=110776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:48:15.559063 dv-cinder-815582-16-smb devstack@n-api.service[110776]: INFO nova.api.openstack.requestlog [None req-31dce05b-6f82-4f32-b609-7d71b7159fde admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012936 Oct 17 03:48:15.559624 dv-cinder-815582-16-smb devstack@n-api.service[110776]: [pid: 110776|app: 0|req: 32/65] 10.222.0.16 () {60 vars in 1283 bytes} [Mon Oct 17 03:48:15 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:48:15.571618 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi [None req-4177ab3c-d69d-47dd-b49c-5e9e10aafd49 admin admin] Calling method '>' {{(pid=110777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:48:15.579138 dv-cinder-815582-16-smb devstack@n-api.service[110777]: INFO nova.api.openstack.requestlog [None req-4177ab3c-d69d-47dd-b49c-5e9e10aafd49 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011140 Oct 17 03:48:15.579698 dv-cinder-815582-16-smb devstack@n-api.service[110777]: [pid: 110777|app: 0|req: 34/66] 10.222.0.16 () {60 vars in 1286 bytes} [Mon Oct 17 03:48:15 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:48:15.591142 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi [None req-7ca183b6-0e19-43cb-81b3-19827349cd80 admin admin] Calling method '>' {{(pid=110776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:48:15.599320 dv-cinder-815582-16-smb devstack@n-api.service[110776]: INFO nova.api.openstack.requestlog [None req-7ca183b6-0e19-43cb-81b3-19827349cd80 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011613 Oct 17 03:48:15.599840 dv-cinder-815582-16-smb devstack@n-api.service[110776]: [pid: 110776|app: 0|req: 33/67] 10.222.0.16 () {60 vars in 1286 bytes} [Mon Oct 17 03:48:15 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:48:15.611045 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi [None req-a0cd0184-46f2-4487-8ae3-ecb9e0c0188d admin admin] Calling method '>' {{(pid=110777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:48:15.618987 dv-cinder-815582-16-smb devstack@n-api.service[110777]: INFO nova.api.openstack.requestlog [None req-a0cd0184-46f2-4487-8ae3-ecb9e0c0188d admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011400 Oct 17 03:48:15.619536 dv-cinder-815582-16-smb devstack@n-api.service[110777]: [pid: 110777|app: 0|req: 35/68] 10.222.0.16 () {60 vars in 1283 bytes} [Mon Oct 17 03:48:15 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:51:45.693072 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi [None req-7ca183b6-0e19-43cb-81b3-19827349cd80 admin admin] Calling method '>' {{(pid=110776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:51:45.694082 dv-cinder-815582-16-smb devstack@n-api.service[110776]: INFO nova.api.openstack.requestlog [None req-7ca183b6-0e19-43cb-81b3-19827349cd80 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Oct 17 03:51:45.694471 dv-cinder-815582-16-smb devstack@n-api.service[110776]: [pid: 110776|app: 0|req: 34/69] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Oct 17 03:51:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:51:45.833444 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG dbcounter [-] [110777] Writing DB stats nova_api:SELECT=6 {{(pid=110777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:51:45.976738 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi [None req-598ecb6e-23ef-4050-973c-7609a949e780 admin admin] Calling method '>' {{(pid=110777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:51:45.981365 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG oslo_concurrency.lockutils [None req-598ecb6e-23ef-4050-973c-7609a949e780 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:51:45.981832 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG oslo_concurrency.lockutils [None req-598ecb6e-23ef-4050-973c-7609a949e780 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:51:45.982255 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG oslo_concurrency.lockutils [None req-598ecb6e-23ef-4050-973c-7609a949e780 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:51:45.982952 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG oslo_concurrency.lockutils [None req-598ecb6e-23ef-4050-973c-7609a949e780 admin admin] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:51:45.983419 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG oslo_concurrency.lockutils [None req-598ecb6e-23ef-4050-973c-7609a949e780 admin admin] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:51:45.983829 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG oslo_concurrency.lockutils [None req-598ecb6e-23ef-4050-973c-7609a949e780 admin admin] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:51:46.015093 dv-cinder-815582-16-smb devstack@n-api.service[110777]: INFO nova.api.openstack.requestlog [None req-598ecb6e-23ef-4050-973c-7609a949e780 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 788 microversion: 2.92 time: 0.182775 Oct 17 03:51:46.015673 dv-cinder-815582-16-smb devstack@n-api.service[110777]: [pid: 110777|app: 0|req: 36/70] 10.222.0.16 () {60 vars in 1193 bytes} [Mon Oct 17 03:51:45 2022] GET /compute/v2.1/os-services => generated 788 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 03:51:47.102422 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi [None req-7ca183b6-0e19-43cb-81b3-19827349cd80 admin admin] Calling method '>' {{(pid=110776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:51:47.103527 dv-cinder-815582-16-smb devstack@n-api.service[110776]: INFO nova.api.openstack.requestlog [None req-7ca183b6-0e19-43cb-81b3-19827349cd80 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Oct 17 03:51:47.103997 dv-cinder-815582-16-smb devstack@n-api.service[110776]: [pid: 110776|app: 0|req: 35/71] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Oct 17 03:51:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:51:47.295184 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi [None req-9f25494e-9885-49e1-8945-71d7d4fe1313 admin admin] Calling method '>' {{(pid=110777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:51:47.298669 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG oslo_concurrency.lockutils [None req-9f25494e-9885-49e1-8945-71d7d4fe1313 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:51:47.299165 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG oslo_concurrency.lockutils [None req-9f25494e-9885-49e1-8945-71d7d4fe1313 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:51:47.299628 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG oslo_concurrency.lockutils [None req-9f25494e-9885-49e1-8945-71d7d4fe1313 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:51:47.300337 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG oslo_concurrency.lockutils [None req-9f25494e-9885-49e1-8945-71d7d4fe1313 admin admin] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:51:47.300781 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG oslo_concurrency.lockutils [None req-9f25494e-9885-49e1-8945-71d7d4fe1313 admin admin] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:51:47.301198 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG oslo_concurrency.lockutils [None req-9f25494e-9885-49e1-8945-71d7d4fe1313 admin admin] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:51:47.320706 dv-cinder-815582-16-smb devstack@n-api.service[110777]: INFO nova.api.openstack.requestlog [None req-9f25494e-9885-49e1-8945-71d7d4fe1313 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 788 microversion: 2.92 time: 0.078937 Oct 17 03:51:47.321201 dv-cinder-815582-16-smb devstack@n-api.service[110777]: [pid: 110777|app: 0|req: 37/72] 10.222.0.16 () {60 vars in 1193 bytes} [Mon Oct 17 03:51:47 2022] GET /compute/v2.1/os-services => generated 788 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 03:51:58.814514 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi [None req-7ca183b6-0e19-43cb-81b3-19827349cd80 admin admin] Calling method '>' {{(pid=110776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:51:58.816082 dv-cinder-815582-16-smb devstack@n-api.service[110776]: INFO nova.api.openstack.requestlog [None req-7ca183b6-0e19-43cb-81b3-19827349cd80 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Oct 17 03:51:58.816469 dv-cinder-815582-16-smb devstack@n-api.service[110776]: [pid: 110776|app: 0|req: 36/73] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Oct 17 03:51:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:51:58.958171 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG dbcounter [-] [110777] Writing DB stats nova_cell0:SELECT=4 {{(pid=110777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:51:58.958915 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG dbcounter [-] [110777] Writing DB stats nova_cell1:SELECT=4 {{(pid=110777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:51:58.959543 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG dbcounter [-] [110777] Writing DB stats nova_api:SELECT=8 {{(pid=110777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:51:59.008040 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi [None req-68fea92b-a33b-4a6e-b6f6-54c35af316ca admin admin] Calling method '>' {{(pid=110777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:51:59.011654 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG oslo_concurrency.lockutils [None req-68fea92b-a33b-4a6e-b6f6-54c35af316ca admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:51:59.012449 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG oslo_concurrency.lockutils [None req-68fea92b-a33b-4a6e-b6f6-54c35af316ca admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:51:59.012877 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG oslo_concurrency.lockutils [None req-68fea92b-a33b-4a6e-b6f6-54c35af316ca admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:51:59.013584 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG oslo_concurrency.lockutils [None req-68fea92b-a33b-4a6e-b6f6-54c35af316ca admin admin] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:51:59.014029 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG oslo_concurrency.lockutils [None req-68fea92b-a33b-4a6e-b6f6-54c35af316ca admin admin] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:51:59.014446 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG oslo_concurrency.lockutils [None req-68fea92b-a33b-4a6e-b6f6-54c35af316ca admin admin] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:51:59.041453 dv-cinder-815582-16-smb devstack@n-api.service[110777]: INFO nova.api.openstack.requestlog [None req-68fea92b-a33b-4a6e-b6f6-54c35af316ca admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1032 microversion: 2.92 time: 0.088224 Oct 17 03:51:59.042194 dv-cinder-815582-16-smb devstack@n-api.service[110777]: [pid: 110777|app: 0|req: 38/74] 10.222.0.16 () {60 vars in 1193 bytes} [Mon Oct 17 03:51:58 2022] GET /compute/v2.1/os-services => generated 1032 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:52:00.116034 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG nova.api.openstack.wsgi [None req-7ca183b6-0e19-43cb-81b3-19827349cd80 admin admin] Calling method '>' {{(pid=110776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:52:00.117058 dv-cinder-815582-16-smb devstack@n-api.service[110776]: INFO nova.api.openstack.requestlog [None req-7ca183b6-0e19-43cb-81b3-19827349cd80 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Oct 17 03:52:00.117452 dv-cinder-815582-16-smb devstack@n-api.service[110776]: [pid: 110776|app: 0|req: 37/75] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Oct 17 03:52:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:52:00.308964 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG nova.api.openstack.wsgi [None req-509f87d0-8334-4dd1-a4e4-a29baf747c0f admin admin] Calling method '>' {{(pid=110777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:52:00.312410 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG oslo_concurrency.lockutils [None req-509f87d0-8334-4dd1-a4e4-a29baf747c0f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:52:00.312886 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG oslo_concurrency.lockutils [None req-509f87d0-8334-4dd1-a4e4-a29baf747c0f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:52:00.313332 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG oslo_concurrency.lockutils [None req-509f87d0-8334-4dd1-a4e4-a29baf747c0f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:52:00.314044 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG oslo_concurrency.lockutils [None req-509f87d0-8334-4dd1-a4e4-a29baf747c0f admin admin] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:52:00.314485 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG oslo_concurrency.lockutils [None req-509f87d0-8334-4dd1-a4e4-a29baf747c0f admin admin] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:52:00.314899 dv-cinder-815582-16-smb devstack@n-api.service[110777]: DEBUG oslo_concurrency.lockutils [None req-509f87d0-8334-4dd1-a4e4-a29baf747c0f admin admin] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:52:00.335945 dv-cinder-815582-16-smb devstack@n-api.service[110777]: INFO nova.api.openstack.requestlog [None req-509f87d0-8334-4dd1-a4e4-a29baf747c0f admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1032 microversion: 2.92 time: 0.080458 Oct 17 03:52:00.336421 dv-cinder-815582-16-smb devstack@n-api.service[110777]: [pid: 110777|app: 0|req: 39/76] 10.222.0.16 () {60 vars in 1193 bytes} [Mon Oct 17 03:52:00 2022] GET /compute/v2.1/os-services => generated 1032 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:52:58.637724 dv-cinder-815582-16-smb systemd[1]: Stopping Devstack devstack@n-api.service... Oct 17 03:52:58.638351 dv-cinder-815582-16-smb devstack@n-api.service[110775]: Mon Oct 17 03:52:58 2022 - graceful shutdown triggered... Oct 17 03:52:58.638833 dv-cinder-815582-16-smb devstack@n-api.service[110777]: Gracefully killing worker 2 (pid: 110777)... Oct 17 03:52:58.639225 dv-cinder-815582-16-smb devstack@n-api.service[110776]: Gracefully killing worker 1 (pid: 110776)... Oct 17 03:52:58.764343 dv-cinder-815582-16-smb devstack@n-api.service[110776]: DEBUG dbcounter [-] [110776] Writing DB stats nova_api:SELECT=4 {{(pid=110776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:52:59.639280 dv-cinder-815582-16-smb devstack@n-api.service[110775]: worker 1 buried after 1 seconds Oct 17 03:52:59.639280 dv-cinder-815582-16-smb devstack@n-api.service[110775]: worker 2 buried after 1 seconds Oct 17 03:52:59.639280 dv-cinder-815582-16-smb devstack@n-api.service[110775]: goodbye to uWSGI. Oct 17 03:52:59.640891 dv-cinder-815582-16-smb systemd[1]: devstack@n-api.service: Succeeded. Oct 17 03:52:59.641431 dv-cinder-815582-16-smb systemd[1]: Stopped Devstack devstack@n-api.service. Oct 17 03:52:59.644685 dv-cinder-815582-16-smb systemd[1]: Starting Devstack devstack@n-api.service... Oct 17 03:52:59.654701 dv-cinder-815582-16-smb devstack@n-api.service[125857]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 17 03:52:59.656708 dv-cinder-815582-16-smb devstack@n-api.service[125857]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 17 03:52:59 2022] *** Oct 17 03:52:59.656880 dv-cinder-815582-16-smb devstack@n-api.service[125857]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 17 03:52:59.657025 dv-cinder-815582-16-smb devstack@n-api.service[125857]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 17 03:52:59.657147 dv-cinder-815582-16-smb devstack@n-api.service[125857]: nodename: dv-cinder-815582-16-smb Oct 17 03:52:59.657292 dv-cinder-815582-16-smb devstack@n-api.service[125857]: machine: x86_64 Oct 17 03:52:59.657420 dv-cinder-815582-16-smb devstack@n-api.service[125857]: clock source: unix Oct 17 03:52:59.657539 dv-cinder-815582-16-smb devstack@n-api.service[125857]: pcre jit disabled Oct 17 03:52:59.657648 dv-cinder-815582-16-smb devstack@n-api.service[125857]: detected number of CPU cores: 4 Oct 17 03:52:59.657757 dv-cinder-815582-16-smb devstack@n-api.service[125857]: current working directory: / Oct 17 03:52:59.657876 dv-cinder-815582-16-smb devstack@n-api.service[125857]: detected binary path: /usr/bin/uwsgi-core Oct 17 03:52:59.658004 dv-cinder-815582-16-smb devstack@n-api.service[125857]: your processes number limit is 47680 Oct 17 03:52:59.658116 dv-cinder-815582-16-smb devstack@n-api.service[125857]: your memory page size is 4096 bytes Oct 17 03:52:59.658229 dv-cinder-815582-16-smb devstack@n-api.service[125857]: detected max file descriptor number: 2048 Oct 17 03:52:59.658366 dv-cinder-815582-16-smb devstack@n-api.service[125857]: lock engine: pthread robust mutexes Oct 17 03:52:59.658532 dv-cinder-815582-16-smb devstack@n-api.service[125857]: thunder lock: enabled Oct 17 03:52:59.658889 dv-cinder-815582-16-smb devstack@n-api.service[125857]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 17 03:52:59.659017 dv-cinder-815582-16-smb devstack@n-api.service[125857]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 17 03:52:59.698674 dv-cinder-815582-16-smb devstack@n-api.service[125857]: Python main interpreter initialized at 0x5608e656f9c0 Oct 17 03:52:59.698674 dv-cinder-815582-16-smb devstack@n-api.service[125857]: python threads support enabled Oct 17 03:52:59.698674 dv-cinder-815582-16-smb devstack@n-api.service[125857]: your server socket listen backlog is limited to 100 connections Oct 17 03:52:59.698674 dv-cinder-815582-16-smb devstack@n-api.service[125857]: your mercy for graceful operations on workers is 90 seconds Oct 17 03:52:59.699126 dv-cinder-815582-16-smb devstack@n-api.service[125857]: mapped 403077 bytes (393 KB) for 2 cores Oct 17 03:52:59.699126 dv-cinder-815582-16-smb devstack@n-api.service[125857]: *** Operational MODE: preforking *** Oct 17 03:52:59.699430 dv-cinder-815582-16-smb devstack@n-api.service[125857]: *** uWSGI is running in multiple interpreter mode *** Oct 17 03:52:59.699430 dv-cinder-815582-16-smb devstack@n-api.service[125857]: spawned uWSGI master process (pid: 125857) Oct 17 03:52:59.699636 dv-cinder-815582-16-smb systemd[1]: Started Devstack devstack@n-api.service. Oct 17 03:52:59.700695 dv-cinder-815582-16-smb devstack@n-api.service[125857]: spawned uWSGI worker 1 (pid: 125871, cores: 1) Oct 17 03:52:59.701185 dv-cinder-815582-16-smb devstack@n-api.service[125857]: spawned uWSGI worker 2 (pid: 125872, cores: 1) Oct 17 03:52:59.701542 dv-cinder-815582-16-smb devstack@n-api.service[125857]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 17 03:53:00.359127 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 17 03:53:00.359756 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 17 03:53:01.512411 dv-cinder-815582-16-smb devstack@n-api.service[125871]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 03:53:01.512411 dv-cinder-815582-16-smb devstack@n-api.service[125871]: from cryptography.utils import int_from_bytes Oct 17 03:53:01.513049 dv-cinder-815582-16-smb devstack@n-api.service[125871]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 03:53:01.513049 dv-cinder-815582-16-smb devstack@n-api.service[125871]: from cryptography.utils import int_from_bytes Oct 17 03:53:01.527865 dv-cinder-815582-16-smb devstack@n-api.service[125872]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 03:53:01.527865 dv-cinder-815582-16-smb devstack@n-api.service[125872]: from cryptography.utils import int_from_bytes Oct 17 03:53:01.528392 dv-cinder-815582-16-smb devstack@n-api.service[125872]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 03:53:01.528392 dv-cinder-815582-16-smb devstack@n-api.service[125872]: from cryptography.utils import int_from_bytes Oct 17 03:53:03.929579 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 17 03:53:03.930183 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 17 03:53:03.930391 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 17 03:53:03.930756 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 17 03:53:03.931010 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 17 03:53:03.931428 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.931755 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.932078 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.932397 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.932727 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.933036 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.933360 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.933676 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.934003 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.934270 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.934583 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.935070 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815582-16-smb {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.935419 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.935729 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.936042 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.936364 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.936673 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.936996 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.937316 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.937825 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.938283 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.939115 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.939474 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.939833 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.940133 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.940450 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.940771 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.941084 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.941415 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.941727 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.942139 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815582-16-smb {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.942464 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.942779 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.943094 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.943546 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.943862 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.944176 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.944497 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.944827 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.945136 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.945462 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.945784 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.946104 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.946423 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.946726 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.947035 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.947370 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.947690 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.947997 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.948301 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.948551 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.948860 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.949181 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.949501 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.949822 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.950073 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.950326 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.950644 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.950965 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.951297 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.951609 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.951916 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.952226 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.952537 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.952847 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.953154 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.953463 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.953783 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.954101 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.955007 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.955345 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.955669 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.956070 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.956323 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.956630 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.956970 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.957291 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.957564 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 17 03:53:03.957984 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.958083 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 17 03:53:03.958176 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.958318 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.958417 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 17 03:53:03.958512 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.958692 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 17 03:53:03.958782 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.958930 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 17 03:53:03.959096 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.959385 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.959492 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.959714 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.959816 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.960038 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.960141 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.960345 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.960503 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.960636 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.960738 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.960943 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.961035 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.961262 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.961372 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.961576 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.961684 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.961889 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.961997 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.962168 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.962284 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.962456 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.962555 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.962781 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.962898 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815582-16-smb {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.963091 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.963267 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.963424 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.963540 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.963732 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.963842 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.964043 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.964146 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.964352 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.964445 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.964665 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.964771 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.964970 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.965120 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.965278 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.965540 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.965647 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.965855 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.965958 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.966161 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.966263 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.966471 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.966574 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.966784 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.966885 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.967093 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.967218 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.967426 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.967519 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.967744 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.967846 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.968049 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.968165 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.968359 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.968452 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.968669 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.968772 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.968993 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.969141 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815582-16-smb {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.969281 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.969373 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.969598 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.969733 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.970477 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.970630 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.970770 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.970970 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.971075 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.971314 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.971452 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.971630 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.971748 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.971954 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.972070 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.972283 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.972393 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.972589 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.972695 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.972914 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.973036 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.973238 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.973351 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.973560 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.973670 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.973861 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.974010 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.974166 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.974269 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.974470 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.974563 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.974769 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.974871 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.975085 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.975260 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.975429 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.975523 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.975734 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.975844 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.975985 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.976125 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.976296 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.976437 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.976618 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.976757 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.976939 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.977097 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:03.977263 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.977431 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:03.977532 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.977754 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.977848 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:03.978071 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.978164 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:03.978392 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.978499 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:03.978702 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.978806 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:03.979010 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.979104 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:03.979343 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.979450 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:03.979657 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:03.979757 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.979962 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.980054 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:03.980270 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.980364 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:03.980583 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:03.980700 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.980890 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.981010 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:03.981205 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:03.981320 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.981519 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.981623 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:03.981842 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.981948 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:03.982151 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.982257 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:03.982462 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:03.982567 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.982781 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:03.982887 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.983090 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.983288 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:03.983437 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.983531 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:03.983745 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:03.983857 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.984061 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.984160 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:03.984372 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.984475 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:03.984693 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.984811 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:03.985014 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.985122 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:03.985315 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.985414 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:03.986189 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.986307 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:03.986502 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.986603 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:03.986823 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.986932 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:03.987136 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:03.987346 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.987494 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:03.987638 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.987787 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.987966 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:03.988193 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:03.988340 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.988484 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:03.988639 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.988785 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:03.988937 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.989096 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:03.989249 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.989431 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:03.989586 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.989730 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:03.989875 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.990029 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:03.990180 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.990325 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:03.990476 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.990640 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:03.990786 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.990938 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:03.991094 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.991094 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.991420 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:03.991575 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.991720 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:03.991873 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.992020 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:03.992163 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.992315 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:03.992467 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.992630 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:03.992776 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.992927 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:03.993074 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.993217 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:03.993369 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.993528 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:03.993674 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.993817 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:03.993969 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.994126 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:03.994282 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.994447 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:03.994593 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.994829 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:03.994995 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.995275 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:03.995447 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.995601 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:03.995746 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.995890 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:03.996040 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.996200 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:03.996345 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.996489 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:03.996643 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.996794 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:03.996976 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.997137 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:03.997292 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.997438 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:03.997581 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.997726 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:03.997870 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.998027 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:03.998179 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.998325 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:03.998468 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.998631 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:03.998786 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.998931 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:03.999076 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.999249 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:03.999403 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.999547 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:03.999705 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:03.999858 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.000010 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:04.000162 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.000308 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:04.000452 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.000626 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:04.000780 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.000925 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:04.001075 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.001220 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:04.001371 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.001534 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:04.001534 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:04.001817 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.001961 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:04.002104 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.002247 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:04.002400 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.002567 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:04.002721 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.002867 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:04.003018 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.003197 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:04.003350 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.003505 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:53:04.003652 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.003803 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.003948 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.004105 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.004258 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.004258 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.004558 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.004558 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.004851 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.005074 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.005244 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.005468 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.005627 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.005627 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.005924 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.006085 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.006230 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.006374 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.006528 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.006673 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.006827 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.006973 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.007116 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.007285 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.007431 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.007585 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.007744 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.007899 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.008052 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.008197 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.008359 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.008504 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.008657 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.008810 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.008962 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.009108 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.009252 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.009404 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.009549 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.009700 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.009845 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.009989 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.010132 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.010294 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.010448 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.010600 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.010746 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.010746 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.011027 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.011247 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.011661 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.011811 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.011968 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.012121 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.012266 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.012418 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.012619 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.012777 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.012930 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.013084 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.013242 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.013403 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.013555 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.013705 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.013863 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.014023 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.014258 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.014413 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.014564 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.014724 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.014875 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.015051 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.015324 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.015503 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.015728 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.015893 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.016053 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.016214 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.016376 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.016536 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.016688 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.016838 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.016999 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.017160 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.017352 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.017512 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.017672 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.017824 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.017984 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.018145 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.018306 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.018465 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.018617 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.018778 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.018941 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.019107 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.019317 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.019471 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.019622 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.019773 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.019924 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.020091 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.020244 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.020403 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.020554 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.020705 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.020854 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.021024 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.021188 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.021347 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.021506 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.021664 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.021832 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.021991 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.022149 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.022309 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.022468 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.022627 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.022791 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.022950 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.023124 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.023318 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.023475 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.023633 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.023795 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.023954 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.024120 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.024279 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.024430 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.024589 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.024753 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.024919 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.025079 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.025240 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.025491 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.025664 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.025909 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.026067 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.026218 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.026369 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.026528 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.026691 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.026863 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.027022 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.027197 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.027358 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.027520 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.027689 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.027843 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.027993 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.028144 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.028302 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.028461 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.028623 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.028776 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.028926 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.029084 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.029237 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.029412 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.029576 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.029737 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.029889 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.030047 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.030199 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.030365 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.030517 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.030666 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.030833 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.030986 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.031144 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.031376 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.031542 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.031694 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.031846 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.032003 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.032155 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.032806 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.032973 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.033132 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.033292 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.033450 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.033615 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.033767 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.033925 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.034096 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.034248 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.034405 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.034570 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.034730 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.034882 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.035043 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.035218 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.035398 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.035645 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.035813 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.036053 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.036211 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.036382 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.036535 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.036695 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.036847 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.037004 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.037163 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.037323 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.037485 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.037637 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.037637 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.037922 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.038079 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.038241 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.038241 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.038537 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.038689 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.038846 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.039005 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.039155 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.039344 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.039505 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.039664 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.039816 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.039969 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.040120 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.040295 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.040456 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.040607 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.040757 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.040906 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.041065 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.041218 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.041369 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.041527 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.041679 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.041836 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.041997 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.041997 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.042303 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.042463 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.042615 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.042764 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.042923 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.043085 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.043276 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.043432 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.043593 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.043755 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.043987 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.044149 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.044319 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.044485 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.044637 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.044793 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.044951 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.045102 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.045259 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.045429 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.045583 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.045820 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.045984 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.046225 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.046390 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.046568 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.046721 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.046877 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.047029 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.047199 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.047368 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.047530 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.047682 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.047833 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.048561 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.048732 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.048895 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.049055 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.049224 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.049376 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.049526 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.049685 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.049850 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.050002 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.050152 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.050309 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.050468 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.050629 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.050792 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.050944 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.051101 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.051328 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.051490 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.051651 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.051813 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.051966 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.052134 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.052297 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.052457 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.052619 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.052772 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.052930 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.053082 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.053233 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.053398 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.053561 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.053714 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.053874 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.054025 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.054185 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.054337 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.054497 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.054656 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.054816 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.054976 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.055127 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.055330 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.055502 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.055655 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.055833 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.056058 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.056234 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.056475 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.056632 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.056791 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.056944 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.057103 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.057255 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.057416 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.057587 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.057740 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.057898 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.058051 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.058203 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.058363 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.058522 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.058681 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.058833 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.058991 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.059158 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.059374 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.059536 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.059707 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.059858 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.060009 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.060171 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.060330 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.060482 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.060641 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.060793 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.060951 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.061116 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.061277 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.061429 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.061580 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.061747 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.061907 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.062073 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.062226 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.062378 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.062529 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.062681 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.062841 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.063052 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.063230 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.063389 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.063541 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.063541 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.063891 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.064045 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.064204 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.064357 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.064508 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.064659 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.064824 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.064976 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.065137 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.065289 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.065457 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.065613 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.065789 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.065942 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.066180 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.066346 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.066594 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.066753 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.066918 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.067071 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.067241 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.067410 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.067564 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.067725 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.067885 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.068056 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.068208 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.068366 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.068524 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.068691 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.068851 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.069010 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.069162 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.069312 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.069463 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.069665 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.069665 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.069955 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.070117 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.070276 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.070443 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.070595 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.070754 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.070912 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.071065 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.071248 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.071425 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.071587 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.071740 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.071891 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.072065 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.072065 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.072361 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.072512 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.072669 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.072822 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.072982 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.073134 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.073285 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.073285 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.073572 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.073732 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.073893 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.074055 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.074214 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.074401 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.074561 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.074743 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.075078 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.075287 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.075454 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.075606 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.075763 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.075999 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.076180 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.076373 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.076541 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.076787 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.076945 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.077109 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.077262 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.077413 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.077563 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.077722 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.077887 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.078049 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.078200 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.078359 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.078511 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.078676 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.078837 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.078998 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.079150 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.079370 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.079524 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.079686 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.079852 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.080006 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.080158 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.080308 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.080466 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.080618 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.080789 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.080980 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.081179 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.081333 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.081484 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.081645 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.081797 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.081956 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.082108 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.082260 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.082410 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.082572 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.082742 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.082895 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.083273 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.083520 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.083690 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.083845 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.084005 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.084166 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.084328 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.084481 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.084643 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.084796 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.084948 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.085212 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.085374 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.085538 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.085699 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.085860 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.086022 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.086175 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.086328 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.086495 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.086656 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.086836 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.087064 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.087295 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.087480 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.087648 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.087802 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.087964 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.087964 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.088271 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.088431 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.088599 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.088753 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.088904 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.089055 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.089213 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.089365 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.089537 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.089702 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.089861 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.090014 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.090166 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.090402 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.090559 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.090712 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.090864 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.091016 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.091188 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.091368 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.091534 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.091687 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.091846 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.092005 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.092159 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.092324 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.092478 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.092640 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.092802 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.092955 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.093113 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.093284 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.093445 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.093608 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.093768 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.093927 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.094088 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.094246 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.094398 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.094557 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.094711 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.095409 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.095588 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.095743 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.095913 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.096081 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.096081 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.096391 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.096391 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.096696 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.096849 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.097016 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.097016 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.097431 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.097595 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.097749 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.097902 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.098053 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.098204 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.098444 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.098607 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.098766 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.098920 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.099073 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.099261 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.099431 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.099586 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.099738 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.099889 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.100041 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.100200 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.100377 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.100539 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.100691 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.100843 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.100996 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.101147 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.101312 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.101472 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.101632 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.101786 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.101937 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.102100 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.102253 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.102415 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.102566 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.102725 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.102878 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.103044 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.103231 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.103392 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.103545 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.103697 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.103859 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.104020 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.104173 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.104338 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.104511 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.104676 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.104837 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.104999 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.105159 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.105319 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.105478 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.105631 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.105792 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.105954 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.106108 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.106259 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.106418 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.106593 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.106756 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.106910 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.107061 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.107261 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.107506 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.107664 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.107830 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.107990 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.108143 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.108294 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.108455 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.108625 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.108788 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.108948 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.109101 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.109252 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.109402 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.109607 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.109768 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.109930 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.110084 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.110244 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.110404 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.111097 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.111322 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.111489 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.111644 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.111844 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.112024 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.112198 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.112360 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.112527 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.112681 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.112844 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.112998 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.113158 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.113158 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.113459 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.113613 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.113775 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.113928 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.114093 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.114254 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.114407 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.114559 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.114725 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.114887 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.115047 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.115226 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.115397 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.115576 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.115739 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.115739 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.116061 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.116214 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.116367 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.116533 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.116689 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.116689 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.116995 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.116995 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.117308 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.117504 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.117744 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.117993 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.118205 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.118364 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.118529 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.118703 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.118857 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.119017 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.119211 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.119385 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.119541 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.119702 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.119871 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.120025 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.120177 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.120340 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.120507 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.120668 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.120823 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.120976 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.121128 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.121290 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.121524 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.121687 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.121849 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.122014 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.122167 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.122319 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.122485 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.122647 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.122863 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.123022 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.123203 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.123382 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.123554 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.123750 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.123750 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.124068 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.124235 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.124398 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.124398 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.124706 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.124706 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.125004 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.125165 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.125332 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.125492 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.125644 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.125803 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.125974 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.126168 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.126339 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.126493 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.126654 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.126815 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.126969 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.127126 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.127328 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.127492 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.127654 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.128453 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.128628 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.128628 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.128960 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.129117 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.129269 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.129431 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.129591 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.129754 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.129909 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.130061 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.130213 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.130372 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.130533 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.130700 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.130854 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.131026 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.131208 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.131208 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.131530 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.131696 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.131857 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.132019 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.132180 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.132339 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.132503 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.132665 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.132819 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.132981 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.133134 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.133294 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.133459 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.133459 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.133766 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.133919 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.134071 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.134232 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.134386 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.134539 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.134700 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.134871 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.135032 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.135218 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.135378 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.135531 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.135684 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.135850 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.136014 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.136181 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.136334 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.136749 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.136903 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.137066 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.137228 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.137383 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.137536 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.137696 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.137851 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.138003 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.138168 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.138323 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.138494 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.138723 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.138882 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.139044 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.139251 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.139413 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.139566 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.139727 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.139727 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.140028 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.140190 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.140343 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.140495 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.140655 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.140815 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.140978 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.141132 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.141296 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.141450 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.141602 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.141791 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.141791 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.142104 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.142258 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.142419 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.142580 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.142734 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.142734 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.143050 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.143050 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.143435 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.143588 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.143753 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.143916 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.144070 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.144233 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.144386 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.144546 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.144707 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.144860 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.145012 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.145174 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.145337 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.145496 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.145666 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.145828 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.145991 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.146145 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.146305 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.146459 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.146625 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.146779 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.146940 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.147093 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.147279 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.147460 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.147615 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.147775 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.147928 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.148080 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.148080 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.148389 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.148543 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.148714 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.148943 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.149110 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.149272 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.149452 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.149615 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.149778 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.149931 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.150092 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.150253 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.150417 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.150571 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.150723 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.150882 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.151036 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.151216 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.151379 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.151544 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.151698 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.151864 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.152019 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.152251 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.152414 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.152569 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.152728 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.152891 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.153052 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.153223 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.153377 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.153531 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.153695 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.153695 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.153983 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.153983 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.154284 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.154284 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.154573 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.154725 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.154886 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.155046 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.155250 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.155412 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.155566 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.155740 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.155915 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.156079 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.156240 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.156400 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.156400 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.156690 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.156853 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.157013 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.157174 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.157837 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.157837 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.158158 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.158325 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.158479 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.158631 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.158784 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.158964 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.159230 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.159393 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.159554 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.159715 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.159878 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.160039 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.160202 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.160375 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.160529 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.160529 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.160828 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.160981 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.161143 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.161306 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.161460 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.161460 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.161756 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.161756 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.162071 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.162246 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.162400 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.162552 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.162712 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.162879 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.163035 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.163035 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.163383 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.163540 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.163699 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.163862 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.164024 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.164195 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.164358 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.164511 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.164673 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.164827 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.164979 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.165139 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.165294 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.165446 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.165612 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.165765 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.165925 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.166087 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.166252 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.166422 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.166586 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.166740 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.166893 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.167268 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.167433 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.167596 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.167758 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.167921 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.168082 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.168237 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.168407 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.168407 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.168722 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.168883 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.169037 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.169208 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.169368 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.169535 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.169690 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.169842 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.169995 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.170153 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.170328 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.170482 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.170643 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.170797 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.170957 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.171112 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.171309 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.171623 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.171792 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.171946 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.172099 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.172251 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.172418 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.172583 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.172743 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.172904 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.173600 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.173757 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.173919 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.174079 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.174240 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.174405 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.174561 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.174728 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.174895 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.175056 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.175335 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.175520 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.175520 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.175837 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.175837 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.176145 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.176300 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.176462 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.176617 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.176779 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.176940 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.177101 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.177273 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.177426 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.177589 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.177750 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.177911 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.178063 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.178230 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.178396 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.178559 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.178714 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.178867 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.179026 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.179269 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.179452 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.179616 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.179771 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.179930 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.180084 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.180246 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.180401 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.180568 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.180722 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.180874 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.181026 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.181185 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.181363 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.181517 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.181677 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.181833 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.181985 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.182138 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.182328 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.183046 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.183248 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.183412 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.183567 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.183719 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.183963 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.184140 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.184308 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.184462 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.184615 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.184768 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.184931 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.185093 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.185253 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.185408 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.185570 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.185733 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.185887 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.186041 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.186215 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.186383 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.186541 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.186708 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.186870 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.187026 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.187220 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.187383 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.187537 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.187702 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.187857 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.188009 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.188170 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.188341 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.188494 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.188687 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.188850 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.189004 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.189165 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.189165 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.189466 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.189466 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.189766 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.189927 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.190087 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.190087 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.190416 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.190416 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.190717 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.190717 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.191014 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.191198 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.191378 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.191542 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.191696 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.191856 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.192009 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.192162 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.192339 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.192501 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.192662 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.192816 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.192968 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.193130 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.193284 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.193445 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.193606 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.193767 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.193928 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.194092 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.194255 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.194427 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.194581 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.194734 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.194895 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.195058 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.195249 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.195411 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.195591 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.195804 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.195979 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.196134 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.196295 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.196470 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.196632 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.196785 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.196952 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.197107 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.197268 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.197421 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.197574 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.197726 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.197889 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.198043 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.198202 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.198366 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.198531 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.198694 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.198861 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.199603 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.199783 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.199947 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.200116 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.200285 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.200447 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.200607 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.200761 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.200913 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.201080 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.201247 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.201409 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.201563 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.201716 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.201882 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.202045 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.202206 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.202361 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.202513 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.202665 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.202833 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.203007 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.203228 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.203395 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.203547 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.203712 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.203874 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.204042 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.204236 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.204397 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.204558 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.204712 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.204881 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.205046 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.205217 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.205372 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.205531 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.205693 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.205861 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.205861 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 17 03:53:04.206163 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.206163 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.206163 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.206163 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.206163 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.206163 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.206163 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.206163 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.207388 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.207388 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.207388 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.207388 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.207388 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.207388 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.207388 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.207388 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.208549 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.208549 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.208549 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.208549 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.208549 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.208549 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.208549 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.208549 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.209711 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.209711 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.209711 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.209711 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.209711 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.209711 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.209711 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.209711 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.211392 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.211392 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.211392 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.211392 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.211392 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.211392 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.211392 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.211392 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.212044 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.212044 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.212044 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.212044 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.212044 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.212044 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.212044 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.212044 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.212659 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.212659 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.212659 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.212659 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.212659 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.212659 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.212659 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.212659 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.213402 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.213402 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.213402 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.213402 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.213402 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.213402 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.213402 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.213402 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.214037 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.214037 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.214037 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.214037 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.214037 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.214037 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.214037 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.214037 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.214570 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.214570 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.214570 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.214570 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.214570 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.214895 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.214973 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.215339 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.215590 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.215896 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:53:04.216140 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 17 03:53:04.252164 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO dbcounter [None req-4d3ce76c-7d28-4171-95e6-7982168ec3db None None] Registered counter for database nova_api Oct 17 03:53:04.272779 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_db.sqlalchemy.engines [None req-4d3ce76c-7d28-4171-95e6-7982168ec3db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125871) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 03:53:04.278720 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO dbcounter [None req-aedd1918-d232-4d78-94ee-1621596eb0ca None None] Registered counter for database nova_api Oct 17 03:53:04.280065 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writer thread running {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 03:53:04.299352 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_db.sqlalchemy.engines [None req-aedd1918-d232-4d78-94ee-1621596eb0ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125872) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 03:53:04.305981 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writer thread running {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 03:53:04.336298 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.context [None req-4d3ce76c-7d28-4171-95e6-7982168ec3db None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),362d8516-367c-40ac-bf4b-219a46bd8926(cell1) {{(pid=125871) load_cells /opt/stack/nova/nova/context.py:464}} Oct 17 03:53:04.340373 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-4d3ce76c-7d28-4171-95e6-7982168ec3db None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:53:04.340845 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-4d3ce76c-7d28-4171-95e6-7982168ec3db None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:53:04.342442 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-4d3ce76c-7d28-4171-95e6-7982168ec3db None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:53:04.343275 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-4d3ce76c-7d28-4171-95e6-7982168ec3db None None] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:53:04.343764 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-4d3ce76c-7d28-4171-95e6-7982168ec3db None None] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:53:04.346603 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-4d3ce76c-7d28-4171-95e6-7982168ec3db None None] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:53:04.348924 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO dbcounter [None req-4d3ce76c-7d28-4171-95e6-7982168ec3db None None] Registered counter for database nova_cell0 Oct 17 03:53:04.353296 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO dbcounter [None req-4d3ce76c-7d28-4171-95e6-7982168ec3db None None] Registered counter for database nova_cell1 Oct 17 03:53:04.360975 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_db.sqlalchemy.engines [None req-4d3ce76c-7d28-4171-95e6-7982168ec3db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125871) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 03:53:04.362425 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_db.sqlalchemy.engines [None req-4d3ce76c-7d28-4171-95e6-7982168ec3db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125871) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 03:53:04.363417 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.context [None req-aedd1918-d232-4d78-94ee-1621596eb0ca None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),362d8516-367c-40ac-bf4b-219a46bd8926(cell1) {{(pid=125872) load_cells /opt/stack/nova/nova/context.py:464}} Oct 17 03:53:04.367466 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-aedd1918-d232-4d78-94ee-1621596eb0ca None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:53:04.367940 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-aedd1918-d232-4d78-94ee-1621596eb0ca None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:53:04.368860 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writer thread running {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 03:53:04.369489 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-aedd1918-d232-4d78-94ee-1621596eb0ca None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:53:04.370217 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-aedd1918-d232-4d78-94ee-1621596eb0ca None None] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:53:04.370441 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writer thread running {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 03:53:04.370664 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-aedd1918-d232-4d78-94ee-1621596eb0ca None None] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:53:04.372800 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-aedd1918-d232-4d78-94ee-1621596eb0ca None None] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:53:04.374847 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO dbcounter [None req-aedd1918-d232-4d78-94ee-1621596eb0ca None None] Registered counter for database nova_cell0 Oct 17 03:53:04.379082 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO dbcounter [None req-aedd1918-d232-4d78-94ee-1621596eb0ca None None] Registered counter for database nova_cell1 Oct 17 03:53:04.387124 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_db.sqlalchemy.engines [None req-aedd1918-d232-4d78-94ee-1621596eb0ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125872) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 03:53:04.389411 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_db.sqlalchemy.engines [None req-aedd1918-d232-4d78-94ee-1621596eb0ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125872) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 03:53:04.395500 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writer thread running {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 03:53:04.397554 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writer thread running {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 03:53:04.518685 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO dbcounter [None req-4d3ce76c-7d28-4171-95e6-7982168ec3db None None] Registered counter for database nova_cell0 Oct 17 03:53:04.525885 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_db.sqlalchemy.engines [None req-4d3ce76c-7d28-4171-95e6-7982168ec3db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125871) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 03:53:04.530930 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writer thread running {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 03:53:04.546207 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO dbcounter [None req-aedd1918-d232-4d78-94ee-1621596eb0ca None None] Registered counter for database nova_cell0 Oct 17 03:53:04.553223 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_db.sqlalchemy.engines [None req-aedd1918-d232-4d78-94ee-1621596eb0ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125872) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 03:53:04.557944 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writer thread running {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 03:53:04.849849 dv-cinder-815582-16-smb devstack@n-api.service[125871]: WARNING keystonemiddleware.auth_token [None req-4d3ce76c-7d28-4171-95e6-7982168ec3db None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 03:53:04.857387 dv-cinder-815582-16-smb devstack@n-api.service[125871]: WARNING keystonemiddleware.auth_token [None req-4d3ce76c-7d28-4171-95e6-7982168ec3db None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 03:53:04.884640 dv-cinder-815582-16-smb devstack@n-api.service[125872]: WARNING keystonemiddleware.auth_token [None req-aedd1918-d232-4d78-94ee-1621596eb0ca None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 03:53:04.893384 dv-cinder-815582-16-smb devstack@n-api.service[125872]: WARNING keystonemiddleware.auth_token [None req-aedd1918-d232-4d78-94ee-1621596eb0ca None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 03:53:05.202982 dv-cinder-815582-16-smb devstack@n-api.service[125871]: WARNING keystonemiddleware.auth_token [None req-4d3ce76c-7d28-4171-95e6-7982168ec3db None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 03:53:05.210411 dv-cinder-815582-16-smb devstack@n-api.service[125871]: WARNING keystonemiddleware.auth_token [None req-4d3ce76c-7d28-4171-95e6-7982168ec3db None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 03:53:05.215719 dv-cinder-815582-16-smb devstack@n-api.service[125871]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5608e656f9c0 pid: 125871 (default app) Oct 17 03:53:05.252334 dv-cinder-815582-16-smb devstack@n-api.service[125872]: WARNING keystonemiddleware.auth_token [None req-aedd1918-d232-4d78-94ee-1621596eb0ca None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 03:53:05.258435 dv-cinder-815582-16-smb devstack@n-api.service[125872]: WARNING keystonemiddleware.auth_token [None req-aedd1918-d232-4d78-94ee-1621596eb0ca None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 03:53:05.264085 dv-cinder-815582-16-smb devstack@n-api.service[125872]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5608e656f9c0 pid: 125872 (default app) Oct 17 03:53:42.057904 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_api:SELECT=3 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:53:42.062880 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_cell1:SELECT=3 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:53:42.069440 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_cell0:SELECT=3 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:53:42.070333 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_cell0:SELECT=3 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:53:43.524473 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-9a7ed740-87e8-43d6-b336-56988649f4b6 tempest-VolumesNegativeTest-1948943619 tempest-VolumesNegativeTest-1948943619-project] Action: 'create', calling method: .version_select at 0x7fd72b6be4c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1499817771", "metadata": {"Type": "work"}}} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:53:43.530740 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-9a7ed740-87e8-43d6-b336-56988649f4b6 tempest-VolumesNegativeTest-1948943619 tempest-VolumesNegativeTest-1948943619-project] Request method failure captured: Oct 17 03:53:43.530740 dv-cinder-815582-16-smb devstack@n-api.service[125871]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 17 03:53:43.530740 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Accept: application/json Oct 17 03:53:43.530740 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Accept-Encoding: identity Oct 17 03:53:43.530740 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Connection: close Oct 17 03:53:43.530740 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Content-Length: 122 Oct 17 03:53:43.530740 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Content-Type: application/json Oct 17 03:53:43.530740 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Host: 10.222.0.16 Oct 17 03:53:43.530740 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Openstack-System-Scope: None Oct 17 03:53:43.530740 dv-cinder-815582-16-smb devstack@n-api.service[125871]: User-Agent: python-urllib3/1.26.12 Oct 17 03:53:43.530740 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Auth-Token: gAAAAABjTNHFbg3u2EuW6T8MIokaIE5K-Y0_5C0Rsckz1Y2hr55oLlx2sTq4J63j5-IY-G5wQqwmWqq76lVDqkOZQgE3VhENr8WvhUcbse5gHvgelOqdo_0_rn27Jy4MBNKur-uQK9WzYmTDkYrbxnB2Nolw04a0NO7wZfw46sfvMOksNn7pkgM Oct 17 03:53:43.530740 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Domain-Id: None Oct 17 03:53:43.530740 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Domain-Name: None Oct 17 03:53:43.530740 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Identity-Status: Confirmed Oct 17 03:53:43.530740 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Is-Admin-Project: True Oct 17 03:53:43.530740 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Domain-Id: default Oct 17 03:53:43.530740 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Domain-Name: Default Oct 17 03:53:43.530740 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Id: 6e19a020733048c69dfe63fa4c140a2b Oct 17 03:53:43.530740 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Name: tempest-VolumesNegativeTest-1948943619 Oct 17 03:53:43.530740 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Role: reader,member Oct 17 03:53:43.530740 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Roles: reader,member Oct 17 03:53:43.532556 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6e19a020733048c69dfe63fa4c140a2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6e19a020733048c69dfe63fa4c140a2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6e19a020733048c69dfe63fa4c140a2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6e19a020733048c69dfe63fa4c140a2b", "adminURL": "http://10.222.0.16:8080"}]}] Oct 17 03:53:43.532556 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant: tempest-VolumesNegativeTest-1948943619 Oct 17 03:53:43.532556 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant-Id: 6e19a020733048c69dfe63fa4c140a2b Oct 17 03:53:43.532556 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant-Name: tempest-VolumesNegativeTest-1948943619 Oct 17 03:53:43.532556 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User: tempest-VolumesNegativeTest-1948943619-project Oct 17 03:53:43.532556 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Domain-Id: default Oct 17 03:53:43.532556 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Domain-Name: Default Oct 17 03:53:43.532556 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Id: b0b8c633fc6a429089a55bb6970199c2 Oct 17 03:53:43.532556 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Name: tempest-VolumesNegativeTest-1948943619-project Oct 17 03:53:43.532556 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Oct 17 03:53:43.532556 dv-cinder-815582-16-smb devstack@n-api.service[125871]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1499817771", "metadata": {"Type": "work"}}} Oct 17 03:53:43.532556 dv-cinder-815582-16-smb devstack@n-api.service[125871]: method: Oct 17 03:53:43.532556 dv-cinder-815582-16-smb devstack@n-api.service[125871]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 17 03:53:43.533534 dv-cinder-815582-16-smb devstack@n-api.service[125871]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1499817771', 'metadata': {'Type': 'work'}}}} Oct 17 03:53:43.533534 dv-cinder-815582-16-smb devstack@n-api.service[125871]: {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:53:43.533534 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:53:43.533534 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 03:53:43.533534 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 03:53:43.533534 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 03:53:43.533534 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise error Oct 17 03:53:43.533534 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 17 03:53:43.533534 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:53:43.533534 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 17 03:53:43.533534 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 17 03:53:43.533534 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:53:43.533534 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 17 03:53:43.533534 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi '#$%' Oct 17 03:53:43.533534 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:53:43.533534 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:53:43.533534 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:53:43.533534 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:53:43.533534 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:53:43.533534 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:53:43.533534 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:53:43.533534 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:53:43.535222 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 03:53:43.535222 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 03:53:43.535222 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:53:43.535222 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:53:43.535222 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 03:53:43.535222 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 03:53:43.535222 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 03:53:43.535222 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 03:53:43.535222 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 03:53:43.535222 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 03:53:43.535222 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 17 03:53:43.535222 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:53:43.535222 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:53:43.535222 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:53:43.535222 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:53:43.535222 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:53:43.535222 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:53:43.535222 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 03:53:43.535222 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 03:53:43.537251 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 17 03:53:43.537251 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:53:43.539027 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-9a7ed740-87e8-43d6-b336-56988649f4b6 tempest-VolumesNegativeTest-1948943619 tempest-VolumesNegativeTest-1948943619-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=125871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:53:43.540403 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-9a7ed740-87e8-43d6-b336-56988649f4b6 tempest-VolumesNegativeTest-1948943619 tempest-VolumesNegativeTest-1948943619-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.492669 Oct 17 03:53:43.542644 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 1/1] 10.222.0.16 () {60 vars in 1156 bytes} [Mon Oct 17 03:53:42 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1495 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 03:53:43.902845 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-564aeccf-4f22-4be5-b636-708d7799411f tempest-VolumesNegativeTest-1948943619 tempest-VolumesNegativeTest-1948943619-project] Action: 'create', calling method: .version_select at 0x7fd72b76cf70>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1056075946", "metadata": {"Type": "work"}}} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:53:43.909678 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-564aeccf-4f22-4be5-b636-708d7799411f tempest-VolumesNegativeTest-1948943619 tempest-VolumesNegativeTest-1948943619-project] Request method failure captured: Oct 17 03:53:43.909678 dv-cinder-815582-16-smb devstack@n-api.service[125872]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 17 03:53:43.909678 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Accept: application/json Oct 17 03:53:43.909678 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Accept-Encoding: identity Oct 17 03:53:43.909678 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Connection: close Oct 17 03:53:43.909678 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Content-Length: 120 Oct 17 03:53:43.909678 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Content-Type: application/json Oct 17 03:53:43.909678 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Host: 10.222.0.16 Oct 17 03:53:43.909678 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Openstack-System-Scope: None Oct 17 03:53:43.909678 dv-cinder-815582-16-smb devstack@n-api.service[125872]: User-Agent: python-urllib3/1.26.12 Oct 17 03:53:43.909678 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Auth-Token: gAAAAABjTNHFbg3u2EuW6T8MIokaIE5K-Y0_5C0Rsckz1Y2hr55oLlx2sTq4J63j5-IY-G5wQqwmWqq76lVDqkOZQgE3VhENr8WvhUcbse5gHvgelOqdo_0_rn27Jy4MBNKur-uQK9WzYmTDkYrbxnB2Nolw04a0NO7wZfw46sfvMOksNn7pkgM Oct 17 03:53:43.909678 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Domain-Id: None Oct 17 03:53:43.909678 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Domain-Name: None Oct 17 03:53:43.909678 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Identity-Status: Confirmed Oct 17 03:53:43.909678 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Is-Admin-Project: True Oct 17 03:53:43.909678 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Domain-Id: default Oct 17 03:53:43.909678 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Domain-Name: Default Oct 17 03:53:43.909678 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Id: 6e19a020733048c69dfe63fa4c140a2b Oct 17 03:53:43.909678 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Name: tempest-VolumesNegativeTest-1948943619 Oct 17 03:53:43.909678 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Role: reader,member Oct 17 03:53:43.909678 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Roles: reader,member Oct 17 03:53:43.913735 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6e19a020733048c69dfe63fa4c140a2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6e19a020733048c69dfe63fa4c140a2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6e19a020733048c69dfe63fa4c140a2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6e19a020733048c69dfe63fa4c140a2b", "adminURL": "http://10.222.0.16:8080"}]}] Oct 17 03:53:43.913735 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant: tempest-VolumesNegativeTest-1948943619 Oct 17 03:53:43.913735 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant-Id: 6e19a020733048c69dfe63fa4c140a2b Oct 17 03:53:43.913735 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant-Name: tempest-VolumesNegativeTest-1948943619 Oct 17 03:53:43.913735 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User: tempest-VolumesNegativeTest-1948943619-project Oct 17 03:53:43.913735 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Domain-Id: default Oct 17 03:53:43.913735 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Domain-Name: Default Oct 17 03:53:43.913735 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Id: b0b8c633fc6a429089a55bb6970199c2 Oct 17 03:53:43.913735 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Name: tempest-VolumesNegativeTest-1948943619-project Oct 17 03:53:43.913735 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Oct 17 03:53:43.913735 dv-cinder-815582-16-smb devstack@n-api.service[125872]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1056075946", "metadata": {"Type": "work"}}} Oct 17 03:53:43.913735 dv-cinder-815582-16-smb devstack@n-api.service[125872]: method: Oct 17 03:53:43.913735 dv-cinder-815582-16-smb devstack@n-api.service[125872]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 17 03:53:43.915600 dv-cinder-815582-16-smb devstack@n-api.service[125872]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1056075946', 'metadata': {'Type': 'work'}}}} Oct 17 03:53:43.915600 dv-cinder-815582-16-smb devstack@n-api.service[125872]: {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:53:43.915600 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:53:43.915600 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 03:53:43.915600 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 03:53:43.915600 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 03:53:43.915600 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise error Oct 17 03:53:43.915600 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 17 03:53:43.915600 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:53:43.915600 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 17 03:53:43.915600 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 17 03:53:43.915600 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:53:43.915600 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 17 03:53:43.915600 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi '0' Oct 17 03:53:43.915600 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:53:43.915600 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:53:43.915600 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:53:43.915600 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:53:43.915600 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:53:43.915600 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:53:43.915600 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:53:43.915600 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:53:43.916985 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 03:53:43.916985 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 03:53:43.916985 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:53:43.916985 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:53:43.916985 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 03:53:43.916985 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 03:53:43.916985 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 03:53:43.916985 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 03:53:43.916985 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 03:53:43.916985 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 03:53:43.916985 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 17 03:53:43.916985 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:53:43.916985 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:53:43.916985 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:53:43.916985 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:53:43.916985 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:53:43.916985 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:53:43.916985 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 03:53:43.916985 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 03:53:43.919756 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 17 03:53:43.919756 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:53:43.919756 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-564aeccf-4f22-4be5-b636-708d7799411f tempest-VolumesNegativeTest-1948943619 tempest-VolumesNegativeTest-1948943619-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=125872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:53:43.919756 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-564aeccf-4f22-4be5-b636-708d7799411f tempest-VolumesNegativeTest-1948943619 tempest-VolumesNegativeTest-1948943619-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.361607 Oct 17 03:53:43.919756 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 1/2] 10.222.0.16 () {60 vars in 1156 bytes} [Mon Oct 17 03:53:43 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 366 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 17 03:53:43.928220 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-08231370-e54b-488b-86f9-4675f76bb038 tempest-VolumesNegativeTest-1948943619 tempest-VolumesNegativeTest-1948943619-project] Action: 'create', calling method: .version_select at 0x7fd72b6bee50>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-492924006", "metadata": {"Type": "work"}}} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:53:43.941649 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-08231370-e54b-488b-86f9-4675f76bb038 tempest-VolumesNegativeTest-1948943619 tempest-VolumesNegativeTest-1948943619-project] Request method failure captured: Oct 17 03:53:43.941649 dv-cinder-815582-16-smb devstack@n-api.service[125871]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 17 03:53:43.941649 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Accept: application/json Oct 17 03:53:43.941649 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Accept-Encoding: identity Oct 17 03:53:43.941649 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Connection: close Oct 17 03:53:43.941649 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Content-Length: 118 Oct 17 03:53:43.941649 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Content-Type: application/json Oct 17 03:53:43.941649 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Host: 10.222.0.16 Oct 17 03:53:43.941649 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Openstack-System-Scope: None Oct 17 03:53:43.941649 dv-cinder-815582-16-smb devstack@n-api.service[125871]: User-Agent: python-urllib3/1.26.12 Oct 17 03:53:43.941649 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Auth-Token: gAAAAABjTNHFbg3u2EuW6T8MIokaIE5K-Y0_5C0Rsckz1Y2hr55oLlx2sTq4J63j5-IY-G5wQqwmWqq76lVDqkOZQgE3VhENr8WvhUcbse5gHvgelOqdo_0_rn27Jy4MBNKur-uQK9WzYmTDkYrbxnB2Nolw04a0NO7wZfw46sfvMOksNn7pkgM Oct 17 03:53:43.941649 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Domain-Id: None Oct 17 03:53:43.941649 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Domain-Name: None Oct 17 03:53:43.941649 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Identity-Status: Confirmed Oct 17 03:53:43.941649 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Is-Admin-Project: True Oct 17 03:53:43.941649 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Domain-Id: default Oct 17 03:53:43.941649 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Domain-Name: Default Oct 17 03:53:43.941649 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Id: 6e19a020733048c69dfe63fa4c140a2b Oct 17 03:53:43.941649 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Name: tempest-VolumesNegativeTest-1948943619 Oct 17 03:53:43.941649 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Role: reader,member Oct 17 03:53:43.941649 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Roles: reader,member Oct 17 03:53:43.943049 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6e19a020733048c69dfe63fa4c140a2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6e19a020733048c69dfe63fa4c140a2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6e19a020733048c69dfe63fa4c140a2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6e19a020733048c69dfe63fa4c140a2b", "adminURL": "http://10.222.0.16:8080"}]}] Oct 17 03:53:43.943049 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant: tempest-VolumesNegativeTest-1948943619 Oct 17 03:53:43.943049 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant-Id: 6e19a020733048c69dfe63fa4c140a2b Oct 17 03:53:43.943049 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant-Name: tempest-VolumesNegativeTest-1948943619 Oct 17 03:53:43.943049 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User: tempest-VolumesNegativeTest-1948943619-project Oct 17 03:53:43.943049 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Domain-Id: default Oct 17 03:53:43.943049 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Domain-Name: Default Oct 17 03:53:43.943049 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Id: b0b8c633fc6a429089a55bb6970199c2 Oct 17 03:53:43.943049 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Name: tempest-VolumesNegativeTest-1948943619-project Oct 17 03:53:43.943049 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Oct 17 03:53:43.943049 dv-cinder-815582-16-smb devstack@n-api.service[125871]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-492924006", "metadata": {"Type": "work"}}} Oct 17 03:53:43.943049 dv-cinder-815582-16-smb devstack@n-api.service[125871]: method: Oct 17 03:53:43.943049 dv-cinder-815582-16-smb devstack@n-api.service[125871]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 17 03:53:43.947029 dv-cinder-815582-16-smb devstack@n-api.service[125871]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-492924006', 'metadata': {'Type': 'work'}}}} Oct 17 03:53:43.947029 dv-cinder-815582-16-smb devstack@n-api.service[125871]: {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:53:43.947029 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:53:43.947029 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 03:53:43.947029 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 03:53:43.947029 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 03:53:43.947029 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise error Oct 17 03:53:43.947029 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 17 03:53:43.947029 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:53:43.947029 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 17 03:53:43.947029 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 17 03:53:43.947029 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:53:43.947029 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 17 03:53:43.947029 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi '' Oct 17 03:53:43.947029 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:53:43.947029 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:53:43.947029 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:53:43.947029 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:53:43.947029 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:53:43.947029 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:53:43.947029 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:53:43.947029 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:53:43.948474 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 03:53:43.948474 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 03:53:43.948474 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:53:43.948474 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:53:43.948474 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 03:53:43.948474 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 03:53:43.948474 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 03:53:43.948474 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 03:53:43.948474 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 03:53:43.948474 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 03:53:43.948474 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 17 03:53:43.948474 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:53:43.948474 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:53:43.948474 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:53:43.948474 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:53:43.948474 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:53:43.948474 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:53:43.948474 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 03:53:43.948474 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 03:53:43.949594 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 17 03:53:43.949594 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:53:43.949594 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-08231370-e54b-488b-86f9-4675f76bb038 tempest-VolumesNegativeTest-1948943619 tempest-VolumesNegativeTest-1948943619-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=125871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:53:43.949594 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-08231370-e54b-488b-86f9-4675f76bb038 tempest-VolumesNegativeTest-1948943619 tempest-VolumesNegativeTest-1948943619-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.025661 Oct 17 03:53:43.949594 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 2/3] 10.222.0.16 () {60 vars in 1156 bytes} [Mon Oct 17 03:53:43 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 03:53:43.954116 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_api:SELECT=3 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:53:43.955062 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_cell0:SELECT=3 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:53:43.955856 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_cell1:SELECT=3 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:53:43.956863 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_cell0:SELECT=3 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:53:44.027402 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-a3eebefc-b942-4714-8a51-31c7ba95ceb7 tempest-VolumesNegativeTest-1948943619 tempest-VolumesNegativeTest-1948943619-project] Calling method '.version_select at 0x7fd72b700670>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:53:44.569139 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.wsgi [None req-a3eebefc-b942-4714-8a51-31c7ba95ceb7 tempest-VolumesNegativeTest-1948943619 tempest-VolumesNegativeTest-1948943619-project] HTTP exception thrown: Volume tempest-invalid-21831339 could not be found. Oct 17 03:53:44.583887 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-a3eebefc-b942-4714-8a51-31c7ba95ceb7 tempest-VolumesNegativeTest-1948943619 tempest-VolumesNegativeTest-1948943619-project] Request method failure captured: Oct 17 03:53:44.583887 dv-cinder-815582-16-smb devstack@n-api.service[125872]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-21831339 HTTP/1.1 Oct 17 03:53:44.583887 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Accept: application/json Oct 17 03:53:44.583887 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Accept-Encoding: identity Oct 17 03:53:44.583887 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Connection: close Oct 17 03:53:44.583887 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Content-Length: 0 Oct 17 03:53:44.583887 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Content-Type: application/json Oct 17 03:53:44.583887 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Host: 10.222.0.16 Oct 17 03:53:44.583887 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Openstack-System-Scope: None Oct 17 03:53:44.583887 dv-cinder-815582-16-smb devstack@n-api.service[125872]: User-Agent: python-urllib3/1.26.12 Oct 17 03:53:44.583887 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Auth-Token: gAAAAABjTNHFbg3u2EuW6T8MIokaIE5K-Y0_5C0Rsckz1Y2hr55oLlx2sTq4J63j5-IY-G5wQqwmWqq76lVDqkOZQgE3VhENr8WvhUcbse5gHvgelOqdo_0_rn27Jy4MBNKur-uQK9WzYmTDkYrbxnB2Nolw04a0NO7wZfw46sfvMOksNn7pkgM Oct 17 03:53:44.583887 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Domain-Id: None Oct 17 03:53:44.583887 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Domain-Name: None Oct 17 03:53:44.583887 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Identity-Status: Confirmed Oct 17 03:53:44.583887 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Is-Admin-Project: True Oct 17 03:53:44.583887 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Domain-Id: default Oct 17 03:53:44.583887 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Domain-Name: Default Oct 17 03:53:44.583887 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Id: 6e19a020733048c69dfe63fa4c140a2b Oct 17 03:53:44.583887 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Name: tempest-VolumesNegativeTest-1948943619 Oct 17 03:53:44.583887 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Role: reader,member Oct 17 03:53:44.583887 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Roles: reader,member Oct 17 03:53:44.585663 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6e19a020733048c69dfe63fa4c140a2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6e19a020733048c69dfe63fa4c140a2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6e19a020733048c69dfe63fa4c140a2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6e19a020733048c69dfe63fa4c140a2b", "adminURL": "http://10.222.0.16:8080"}]}] Oct 17 03:53:44.585663 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant: tempest-VolumesNegativeTest-1948943619 Oct 17 03:53:44.585663 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant-Id: 6e19a020733048c69dfe63fa4c140a2b Oct 17 03:53:44.585663 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant-Name: tempest-VolumesNegativeTest-1948943619 Oct 17 03:53:44.585663 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User: tempest-VolumesNegativeTest-1948943619-project Oct 17 03:53:44.585663 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Domain-Id: default Oct 17 03:53:44.585663 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Domain-Name: Default Oct 17 03:53:44.585663 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Id: b0b8c633fc6a429089a55bb6970199c2 Oct 17 03:53:44.585663 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Name: tempest-VolumesNegativeTest-1948943619-project Oct 17 03:53:44.585663 dv-cinder-815582-16-smb devstack@n-api.service[125872]: method: Oct 17 03:53:44.585663 dv-cinder-815582-16-smb devstack@n-api.service[125872]: exception: Volume tempest-invalid-21831339 could not be found. Oct 17 03:53:44.585663 dv-cinder-815582-16-smb devstack@n-api.service[125872]: action_args: {'id': 'tempest-invalid-21831339'} Oct 17 03:53:44.585663 dv-cinder-815582-16-smb devstack@n-api.service[125872]: {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:53:44.586678 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:53:44.586678 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 03:53:44.586678 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 03:53:44.586678 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 17 03:53:44.586678 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 17 03:53:44.586678 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 17 03:53:44.586678 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 17 03:53:44.586678 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 17 03:53:44.586678 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 17 03:53:44.586678 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 17 03:53:44.586678 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 17 03:53:44.586678 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 03:53:44.586678 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 03:53:44.586678 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 03:53:44.586678 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 03:53:44.586678 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-21831339 could not be found. (HTTP 404) (Request-ID: req-83f4a74c-486c-42f2-b134-4e0d54a7e8fb) Oct 17 03:53:44.586678 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:53:44.586678 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:53:44.586678 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:53:44.588285 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:53:44.588285 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 17 03:53:44.588285 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 17 03:53:44.588285 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 03:53:44.588285 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 03:53:44.588285 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 03:53:44.588285 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 03:53:44.588285 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 03:53:44.588285 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 03:53:44.588285 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 03:53:44.588285 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 03:53:44.588285 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 17 03:53:44.588285 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 17 03:53:44.588285 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 17 03:53:44.588285 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 17 03:53:44.588285 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 17 03:53:44.588285 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 17 03:53:44.588285 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 17 03:53:44.588285 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 17 03:53:44.590640 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 03:53:44.590640 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 03:53:44.590640 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 03:53:44.590640 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 03:53:44.590640 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-21831339 could not be found. Oct 17 03:53:44.590640 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:53:44.590640 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:53:44.590640 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:53:44.590640 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:53:44.590640 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:53:44.590640 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:53:44.590640 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:53:44.590640 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:53:44.590640 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 03:53:44.590640 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 03:53:44.590640 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:53:44.590640 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:53:44.590640 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 17 03:53:44.590640 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:53:44.590640 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-21831339 could not be found. Oct 17 03:53:44.596579 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:53:44.596579 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:53:44.596579 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:53:44.596579 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:53:44.596579 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:53:44.596579 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:53:44.596579 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:53:44.596579 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:53:44.596579 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-21831339 could not be found. Oct 17 03:53:44.596579 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:53:44.596579 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-a3eebefc-b942-4714-8a51-31c7ba95ceb7 tempest-VolumesNegativeTest-1948943619 tempest-VolumesNegativeTest-1948943619-project] Returning 404 to user: Volume tempest-invalid-21831339 could not be found. {{(pid=125872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:53:44.596579 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-a3eebefc-b942-4714-8a51-31c7ba95ceb7 tempest-VolumesNegativeTest-1948943619 tempest-VolumesNegativeTest-1948943619-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/tempest-invalid-21831339" status: 404 len: 97 microversion: 2.1 time: 0.636818 Oct 17 03:53:44.596579 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 2/4] 10.222.0.16 () {58 vars in 1212 bytes} [Mon Oct 17 03:53:43 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-21831339 => generated 97 bytes in 642 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 03:53:44.603272 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-c8420f7a-ba3d-405d-992c-6ae6dff59c4f tempest-VolumesNegativeTest-1948943619 tempest-VolumesNegativeTest-1948943619-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004429 Oct 17 03:53:44.604115 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 3/5] 10.222.0.16 () {58 vars in 1140 bytes} [Mon Oct 17 03:53:44 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 17 03:53:44.614374 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-610eec89-8425-496f-9de5-25c97c48f6ef tempest-VolumesNegativeTest-1948943619 tempest-VolumesNegativeTest-1948943619-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005448 Oct 17 03:53:44.619931 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 3/6] 10.222.0.16 () {58 vars in 1137 bytes} [Mon Oct 17 03:53:44 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 17 03:53:44.629497 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-3deeca99-827f-4b8a-b5fb-9c4bdbf10c7e tempest-VolumesNegativeTest-1948943619 tempest-VolumesNegativeTest-1948943619-project] Calling method '.version_select at 0x7fd72b5784c0>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:53:45.016877 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.wsgi [None req-3deeca99-827f-4b8a-b5fb-9c4bdbf10c7e tempest-VolumesNegativeTest-1948943619 tempest-VolumesNegativeTest-1948943619-project] HTTP exception thrown: Volume 29bcabcc-5adc-4575-9986-dca0a7f4af85 could not be found. Oct 17 03:53:45.016877 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-3deeca99-827f-4b8a-b5fb-9c4bdbf10c7e tempest-VolumesNegativeTest-1948943619 tempest-VolumesNegativeTest-1948943619-project] Request method failure captured: Oct 17 03:53:45.016877 dv-cinder-815582-16-smb devstack@n-api.service[125871]: request: DELETE /compute/v2.1/os-volumes/29bcabcc-5adc-4575-9986-dca0a7f4af85 HTTP/1.1 Oct 17 03:53:45.016877 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Accept: application/json Oct 17 03:53:45.016877 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Accept-Encoding: identity Oct 17 03:53:45.016877 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Connection: close Oct 17 03:53:45.016877 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Content-Length: 0 Oct 17 03:53:45.016877 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Content-Type: application/json Oct 17 03:53:45.016877 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Host: 10.222.0.16 Oct 17 03:53:45.016877 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Openstack-System-Scope: None Oct 17 03:53:45.016877 dv-cinder-815582-16-smb devstack@n-api.service[125871]: User-Agent: python-urllib3/1.26.12 Oct 17 03:53:45.016877 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Auth-Token: gAAAAABjTNHFbg3u2EuW6T8MIokaIE5K-Y0_5C0Rsckz1Y2hr55oLlx2sTq4J63j5-IY-G5wQqwmWqq76lVDqkOZQgE3VhENr8WvhUcbse5gHvgelOqdo_0_rn27Jy4MBNKur-uQK9WzYmTDkYrbxnB2Nolw04a0NO7wZfw46sfvMOksNn7pkgM Oct 17 03:53:45.016877 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Domain-Id: None Oct 17 03:53:45.016877 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Domain-Name: None Oct 17 03:53:45.016877 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Identity-Status: Confirmed Oct 17 03:53:45.016877 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Is-Admin-Project: True Oct 17 03:53:45.016877 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Domain-Id: default Oct 17 03:53:45.016877 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Domain-Name: Default Oct 17 03:53:45.016877 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Id: 6e19a020733048c69dfe63fa4c140a2b Oct 17 03:53:45.016877 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Name: tempest-VolumesNegativeTest-1948943619 Oct 17 03:53:45.016877 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Role: reader,member Oct 17 03:53:45.016877 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Roles: reader,member Oct 17 03:53:45.019540 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6e19a020733048c69dfe63fa4c140a2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6e19a020733048c69dfe63fa4c140a2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6e19a020733048c69dfe63fa4c140a2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6e19a020733048c69dfe63fa4c140a2b", "adminURL": "http://10.222.0.16:8080"}]}] Oct 17 03:53:45.019540 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant: tempest-VolumesNegativeTest-1948943619 Oct 17 03:53:45.019540 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant-Id: 6e19a020733048c69dfe63fa4c140a2b Oct 17 03:53:45.019540 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant-Name: tempest-VolumesNegativeTest-1948943619 Oct 17 03:53:45.019540 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User: tempest-VolumesNegativeTest-1948943619-project Oct 17 03:53:45.019540 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Domain-Id: default Oct 17 03:53:45.019540 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Domain-Name: Default Oct 17 03:53:45.019540 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Id: b0b8c633fc6a429089a55bb6970199c2 Oct 17 03:53:45.019540 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Name: tempest-VolumesNegativeTest-1948943619-project Oct 17 03:53:45.019540 dv-cinder-815582-16-smb devstack@n-api.service[125871]: method: Oct 17 03:53:45.019540 dv-cinder-815582-16-smb devstack@n-api.service[125871]: exception: Volume 29bcabcc-5adc-4575-9986-dca0a7f4af85 could not be found. Oct 17 03:53:45.019540 dv-cinder-815582-16-smb devstack@n-api.service[125871]: action_args: {'id': '29bcabcc-5adc-4575-9986-dca0a7f4af85'} Oct 17 03:53:45.019540 dv-cinder-815582-16-smb devstack@n-api.service[125871]: {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:53:45.026645 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:53:45.026645 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 03:53:45.026645 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 03:53:45.026645 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 17 03:53:45.026645 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 17 03:53:45.026645 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 17 03:53:45.026645 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 17 03:53:45.026645 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 17 03:53:45.026645 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 17 03:53:45.026645 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 17 03:53:45.026645 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 17 03:53:45.026645 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 03:53:45.026645 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 03:53:45.026645 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 03:53:45.026645 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 03:53:45.026645 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 29bcabcc-5adc-4575-9986-dca0a7f4af85 could not be found. (HTTP 404) (Request-ID: req-4619d029-eebe-4313-b9d1-973a1fce666e) Oct 17 03:53:45.026645 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:53:45.026645 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:53:45.026645 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:53:45.028547 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:53:45.028547 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 17 03:53:45.028547 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 17 03:53:45.028547 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 03:53:45.028547 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 03:53:45.028547 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 03:53:45.028547 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 03:53:45.028547 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 03:53:45.028547 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 03:53:45.028547 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 03:53:45.028547 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 03:53:45.028547 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 17 03:53:45.028547 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 17 03:53:45.028547 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 17 03:53:45.028547 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 17 03:53:45.028547 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 17 03:53:45.028547 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 17 03:53:45.028547 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 17 03:53:45.028547 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 17 03:53:45.029888 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 03:53:45.029888 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 03:53:45.029888 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 03:53:45.029888 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 03:53:45.029888 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 29bcabcc-5adc-4575-9986-dca0a7f4af85 could not be found. Oct 17 03:53:45.029888 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:53:45.029888 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:53:45.029888 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:53:45.029888 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:53:45.029888 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:53:45.029888 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:53:45.029888 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:53:45.029888 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:53:45.029888 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 03:53:45.029888 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 03:53:45.029888 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:53:45.029888 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:53:45.029888 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 17 03:53:45.029888 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:53:45.033241 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 29bcabcc-5adc-4575-9986-dca0a7f4af85 could not be found. Oct 17 03:53:45.033241 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:53:45.033241 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:53:45.033241 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:53:45.033241 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:53:45.033241 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:53:45.033241 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:53:45.033241 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:53:45.033241 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:53:45.033241 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 29bcabcc-5adc-4575-9986-dca0a7f4af85 could not be found. Oct 17 03:53:45.033241 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:53:45.033241 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-3deeca99-827f-4b8a-b5fb-9c4bdbf10c7e tempest-VolumesNegativeTest-1948943619 tempest-VolumesNegativeTest-1948943619-project] Returning 404 to user: Volume 29bcabcc-5adc-4575-9986-dca0a7f4af85 could not be found. {{(pid=125871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:53:45.033241 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-3deeca99-827f-4b8a-b5fb-9c4bdbf10c7e tempest-VolumesNegativeTest-1948943619 tempest-VolumesNegativeTest-1948943619-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/29bcabcc-5adc-4575-9986-dca0a7f4af85" status: 404 len: 109 microversion: 2.1 time: 0.352207 Oct 17 03:53:45.033241 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 4/7] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Oct 17 03:53:44 2022] DELETE /compute/v2.1/os-volumes/29bcabcc-5adc-4575-9986-dca0a7f4af85 => generated 109 bytes in 357 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 03:53:45.035967 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-a3573752-7aa7-4b20-b20c-b431624f9ce6 tempest-VolumesNegativeTest-1948943619 tempest-VolumesNegativeTest-1948943619-project] Calling method '.version_select at 0x7fd72b5241f0>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:53:45.186616 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.wsgi [None req-a3573752-7aa7-4b20-b20c-b431624f9ce6 tempest-VolumesNegativeTest-1948943619 tempest-VolumesNegativeTest-1948943619-project] HTTP exception thrown: Volume cb614f41-258c-4da2-852e-6f0b9d4a73d0 could not be found. Oct 17 03:53:45.190380 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-a3573752-7aa7-4b20-b20c-b431624f9ce6 tempest-VolumesNegativeTest-1948943619 tempest-VolumesNegativeTest-1948943619-project] Request method failure captured: Oct 17 03:53:45.190380 dv-cinder-815582-16-smb devstack@n-api.service[125872]: request: GET /compute/v2.1/os-volumes/cb614f41-258c-4da2-852e-6f0b9d4a73d0 HTTP/1.1 Oct 17 03:53:45.190380 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Accept: application/json Oct 17 03:53:45.190380 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Accept-Encoding: identity Oct 17 03:53:45.190380 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Connection: close Oct 17 03:53:45.190380 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Content-Length: 0 Oct 17 03:53:45.190380 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Content-Type: application/json Oct 17 03:53:45.190380 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Host: 10.222.0.16 Oct 17 03:53:45.190380 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Openstack-System-Scope: None Oct 17 03:53:45.190380 dv-cinder-815582-16-smb devstack@n-api.service[125872]: User-Agent: python-urllib3/1.26.12 Oct 17 03:53:45.190380 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Auth-Token: gAAAAABjTNHFbg3u2EuW6T8MIokaIE5K-Y0_5C0Rsckz1Y2hr55oLlx2sTq4J63j5-IY-G5wQqwmWqq76lVDqkOZQgE3VhENr8WvhUcbse5gHvgelOqdo_0_rn27Jy4MBNKur-uQK9WzYmTDkYrbxnB2Nolw04a0NO7wZfw46sfvMOksNn7pkgM Oct 17 03:53:45.190380 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Domain-Id: None Oct 17 03:53:45.190380 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Domain-Name: None Oct 17 03:53:45.190380 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Identity-Status: Confirmed Oct 17 03:53:45.190380 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Is-Admin-Project: True Oct 17 03:53:45.190380 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Domain-Id: default Oct 17 03:53:45.190380 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Domain-Name: Default Oct 17 03:53:45.190380 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Id: 6e19a020733048c69dfe63fa4c140a2b Oct 17 03:53:45.190380 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Name: tempest-VolumesNegativeTest-1948943619 Oct 17 03:53:45.190380 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Role: reader,member Oct 17 03:53:45.190380 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Roles: reader,member Oct 17 03:53:45.191749 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6e19a020733048c69dfe63fa4c140a2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6e19a020733048c69dfe63fa4c140a2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6e19a020733048c69dfe63fa4c140a2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6e19a020733048c69dfe63fa4c140a2b", "adminURL": "http://10.222.0.16:8080"}]}] Oct 17 03:53:45.191749 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant: tempest-VolumesNegativeTest-1948943619 Oct 17 03:53:45.191749 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant-Id: 6e19a020733048c69dfe63fa4c140a2b Oct 17 03:53:45.191749 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant-Name: tempest-VolumesNegativeTest-1948943619 Oct 17 03:53:45.191749 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User: tempest-VolumesNegativeTest-1948943619-project Oct 17 03:53:45.191749 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Domain-Id: default Oct 17 03:53:45.191749 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Domain-Name: Default Oct 17 03:53:45.191749 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Id: b0b8c633fc6a429089a55bb6970199c2 Oct 17 03:53:45.191749 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Name: tempest-VolumesNegativeTest-1948943619-project Oct 17 03:53:45.191749 dv-cinder-815582-16-smb devstack@n-api.service[125872]: method: Oct 17 03:53:45.191749 dv-cinder-815582-16-smb devstack@n-api.service[125872]: exception: Volume cb614f41-258c-4da2-852e-6f0b9d4a73d0 could not be found. Oct 17 03:53:45.191749 dv-cinder-815582-16-smb devstack@n-api.service[125872]: action_args: {'id': 'cb614f41-258c-4da2-852e-6f0b9d4a73d0'} Oct 17 03:53:45.191749 dv-cinder-815582-16-smb devstack@n-api.service[125872]: {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:53:45.192610 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:53:45.192610 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 03:53:45.192610 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 03:53:45.192610 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 03:53:45.192610 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 03:53:45.192610 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 03:53:45.192610 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 03:53:45.192610 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 03:53:45.192610 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 03:53:45.192610 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 03:53:45.192610 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 03:53:45.192610 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 03:53:45.192610 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 03:53:45.192610 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 03:53:45.192610 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 03:53:45.192610 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cb614f41-258c-4da2-852e-6f0b9d4a73d0 could not be found. (HTTP 404) (Request-ID: req-a4e6ce37-1356-4259-8996-f2458268c0fa) Oct 17 03:53:45.192610 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:53:45.192610 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:53:45.192610 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:53:45.193784 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:53:45.193784 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 17 03:53:45.193784 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 17 03:53:45.193784 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 03:53:45.193784 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 03:53:45.193784 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 03:53:45.193784 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 03:53:45.193784 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 03:53:45.193784 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 03:53:45.193784 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 03:53:45.193784 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 03:53:45.193784 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 03:53:45.193784 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 03:53:45.193784 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 03:53:45.193784 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 03:53:45.193784 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 03:53:45.193784 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 03:53:45.193784 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 03:53:45.193784 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 03:53:45.196489 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 03:53:45.196489 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 03:53:45.196489 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 03:53:45.196489 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 03:53:45.196489 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cb614f41-258c-4da2-852e-6f0b9d4a73d0 could not be found. Oct 17 03:53:45.196489 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:53:45.196489 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:53:45.196489 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:53:45.196489 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:53:45.196489 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:53:45.196489 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:53:45.196489 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:53:45.196489 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:53:45.196489 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 03:53:45.196489 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 03:53:45.196489 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:53:45.196489 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:53:45.196489 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 17 03:53:45.196489 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:53:45.199059 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cb614f41-258c-4da2-852e-6f0b9d4a73d0 could not be found. Oct 17 03:53:45.199059 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:53:45.199059 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:53:45.199059 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:53:45.199059 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:53:45.199059 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:53:45.199059 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:53:45.199059 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:53:45.199059 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:53:45.199059 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cb614f41-258c-4da2-852e-6f0b9d4a73d0 could not be found. Oct 17 03:53:45.199059 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:53:45.214796 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-a3573752-7aa7-4b20-b20c-b431624f9ce6 tempest-VolumesNegativeTest-1948943619 tempest-VolumesNegativeTest-1948943619-project] Returning 404 to user: Volume cb614f41-258c-4da2-852e-6f0b9d4a73d0 could not be found. {{(pid=125872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:53:45.216128 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-a3573752-7aa7-4b20-b20c-b431624f9ce6 tempest-VolumesNegativeTest-1948943619 tempest-VolumesNegativeTest-1948943619-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/cb614f41-258c-4da2-852e-6f0b9d4a73d0" status: 404 len: 109 microversion: 2.1 time: 0.228379 Oct 17 03:53:45.217269 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 4/8] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Oct 17 03:53:44 2022] GET /compute/v2.1/os-volumes/cb614f41-258c-4da2-852e-6f0b9d4a73d0 => generated 109 bytes in 231 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 03:53:46.242960 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-685af97c-d223-4635-9036-317db244fe40 tempest-VolumesTestJSON-1732772499 tempest-VolumesTestJSON-1732772499-project] Calling method '.version_select at 0x7fd72b779e50>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:53:46.327741 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-685af97c-d223-4635-9036-317db244fe40 tempest-VolumesTestJSON-1732772499 tempest-VolumesTestJSON-1732772499-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/ac41e155-d2c0-41fd-bde4-e9d36a030d64" status: 200 len: 350 microversion: 2.1 time: 0.089846 Oct 17 03:53:46.336596 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 5/9] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Oct 17 03:53:46 2022] GET /compute/v2.1/os-volumes/ac41e155-d2c0-41fd-bde4-e9d36a030d64 => generated 350 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:53:48.580126 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-225c6f6e-99b4-4be6-a5ad-d0bac7e2df63 tempest-VolumesTestJSON-1732772499 tempest-VolumesTestJSON-1732772499-project] Calling method '.version_select at 0x7fd72b4f4b80>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:53:48.692977 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-225c6f6e-99b4-4be6-a5ad-d0bac7e2df63 tempest-VolumesTestJSON-1732772499 tempest-VolumesTestJSON-1732772499-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/e0f739d3-3937-4db9-a612-4f0f81a8cd09" status: 200 len: 351 microversion: 2.1 time: 0.117754 Oct 17 03:53:48.693622 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 5/10] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Oct 17 03:53:48 2022] GET /compute/v2.1/os-volumes/e0f739d3-3937-4db9-a612-4f0f81a8cd09 => generated 351 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:53:51.181494 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-87eb2433-20f9-46ad-91b8-99f4671274c9 tempest-VolumesTestJSON-1732772499 tempest-VolumesTestJSON-1732772499-project] Calling method '.version_select at 0x7fd72b4ae700>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:53:51.307968 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-87eb2433-20f9-46ad-91b8-99f4671274c9 tempest-VolumesTestJSON-1732772499 tempest-VolumesTestJSON-1732772499-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/3c39b61d-43cc-4469-9ca6-c3e404284ef9" status: 200 len: 351 microversion: 2.1 time: 0.131175 Oct 17 03:53:51.309416 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 6/11] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Oct 17 03:53:51 2022] GET /compute/v2.1/os-volumes/3c39b61d-43cc-4469-9ca6-c3e404284ef9 => generated 351 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:53:51.325196 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-023a3aca-525a-41c6-8a8e-1e60c3160bf4 tempest-VolumesTestJSON-1732772499 tempest-VolumesTestJSON-1732772499-project] Calling method '.version_select at 0x7fd72b5244c0>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:53:51.506555 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-023a3aca-525a-41c6-8a8e-1e60c3160bf4 tempest-VolumesTestJSON-1732772499 tempest-VolumesTestJSON-1732772499-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.184950 Oct 17 03:53:51.525488 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 6/12] 10.222.0.16 () {58 vars in 1134 bytes} [Mon Oct 17 03:53:51 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:53:51.526017 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-51a5bf05-876d-461d-abd0-7110fd380ad2 tempest-VolumesTestJSON-1732772499 tempest-VolumesTestJSON-1732772499-project] Calling method '.version_select at 0x7fd72b54f820>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:53:51.665330 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-51a5bf05-876d-461d-abd0-7110fd380ad2 tempest-VolumesTestJSON-1732772499 tempest-VolumesTestJSON-1732772499-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.140873 Oct 17 03:53:51.665330 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 7/13] 10.222.0.16 () {58 vars in 1149 bytes} [Mon Oct 17 03:53:51 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:53:51.681659 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-a559f67b-84e3-4e05-ad2b-dd9f327a0d94 tempest-VolumesTestJSON-1732772499 tempest-VolumesTestJSON-1732772499-project] Calling method '.version_select at 0x7fd72b4ab9d0>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:53:51.880968 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-a559f67b-84e3-4e05-ad2b-dd9f327a0d94 tempest-VolumesTestJSON-1732772499 tempest-VolumesTestJSON-1732772499-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.203702 Oct 17 03:53:51.903252 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 7/14] 10.222.0.16 () {58 vars in 1134 bytes} [Mon Oct 17 03:53:51 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:53:51.903698 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-88debf3b-3874-4e34-b217-9ae74f59e2fe tempest-VolumesTestJSON-1732772499 tempest-VolumesTestJSON-1732772499-project] Calling method '.version_select at 0x7fd72b4aec10>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:53:52.085294 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-88debf3b-3874-4e34-b217-9ae74f59e2fe tempest-VolumesTestJSON-1732772499 tempest-VolumesTestJSON-1732772499-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.192002 Oct 17 03:53:52.105960 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 8/15] 10.222.0.16 () {58 vars in 1167 bytes} [Mon Oct 17 03:53:51 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:53:52.111405 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-8c078a27-2e1a-4717-82ba-74c1f9ddf07d tempest-VolumesTestJSON-1732772499 tempest-VolumesTestJSON-1732772499-project] Calling method '.version_select at 0x7fd72b4ab700>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:53:52.244470 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-8c078a27-2e1a-4717-82ba-74c1f9ddf07d tempest-VolumesTestJSON-1732772499 tempest-VolumesTestJSON-1732772499-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.145411 Oct 17 03:53:52.269196 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 8/16] 10.222.0.16 () {58 vars in 1170 bytes} [Mon Oct 17 03:53:52 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:53:52.271162 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-ae1dc410-37c1-4210-96b9-42c5668c3f66 tempest-VolumesTestJSON-1732772499 tempest-VolumesTestJSON-1732772499-project] Calling method '.version_select at 0x7fd72b4b6ee0>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:53:52.492280 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-ae1dc410-37c1-4210-96b9-42c5668c3f66 tempest-VolumesTestJSON-1732772499 tempest-VolumesTestJSON-1732772499-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.231371 Oct 17 03:53:52.493154 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 9/17] 10.222.0.16 () {58 vars in 1155 bytes} [Mon Oct 17 03:53:52 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:53:52.511576 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-a160c74d-9d5e-4d7c-b6e9-76cf77d71aef tempest-VolumesTestJSON-1732772499 tempest-VolumesTestJSON-1732772499-project] Calling method '.version_select at 0x7fd72b524310>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:53:52.738706 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-a160c74d-9d5e-4d7c-b6e9-76cf77d71aef tempest-VolumesTestJSON-1732772499 tempest-VolumesTestJSON-1732772499-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.234810 Oct 17 03:53:52.739572 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 9/18] 10.222.0.16 () {58 vars in 1188 bytes} [Mon Oct 17 03:53:52 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:53:52.766715 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-a6d74d66-7c54-4ae9-a639-0b225bb3fb18 tempest-VolumesTestJSON-1732772499 tempest-VolumesTestJSON-1732772499-project] Calling method '.version_select at 0x7fd72b4aef70>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:53:53.003554 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-a6d74d66-7c54-4ae9-a639-0b225bb3fb18 tempest-VolumesTestJSON-1732772499 tempest-VolumesTestJSON-1732772499-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.249215 Oct 17 03:53:53.004325 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 10/19] 10.222.0.16 () {58 vars in 1155 bytes} [Mon Oct 17 03:53:52 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:53:55.258016 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-4ec295b1-9914-429a-b9be-eb3e4a1de843 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Action: 'create', calling method: .version_select at 0x7fd72b4f4c10>, body: {"keypair": {"name": "tempest-keypair-775223072", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHA4rVt/zFpbjnL0nytLcwSY+VWeCXPM8NHR1t9KfaEfnwpBMHbUztRjxPQDeZZ9y0RDtm3wcBZCgt5brtVBJmuhstxfOGZ7f51sw6/8yHOEU5lBLgGTagtGtGPdHtupLQ=="}} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:53:55.400018 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.quota [None req-4ec295b1-9914-429a-b9be-eb3e4a1de843 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Getting quotas for project 8af3ce80f169473882a247ba78d3d6ef. Resources: {'key_pairs'} {{(pid=125872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 03:53:55.420293 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.quota [None req-4ec295b1-9914-429a-b9be-eb3e4a1de843 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Getting quotas for user e9ac14bb6ceb4d9a92a20938e9688bbd and project 8af3ce80f169473882a247ba78d3d6ef. Resources: {'key_pairs'} {{(pid=125872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 03:53:55.560379 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-4ec295b1-9914-429a-b9be-eb3e4a1de843 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.579723 Oct 17 03:53:55.561596 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 10/20] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 17 03:53:54 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:53:57.986658 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-c9f3bb17-0068-4c22-9e05-c5888e787238 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Action: 'create', calling method: .version_select at 0x7fd72b6d3c10>, body: {"keypair": {"name": "tempest-keypair-120723541", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCMl8WZAP3iZZyGeO84Y891FI17OY7omdkMUoHjshDfAV3CB6wAIs1gb8fDt/IlrhJ8GAwHtgVdyHclcYjgy0HCHvQCmK2Qbv6jjN4e89fEpFV09GxadpkRQrWgbz+fNGQ=="}} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:53:58.097999 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.quota [None req-c9f3bb17-0068-4c22-9e05-c5888e787238 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Getting quotas for project 4dcae38b1a3c47f2a80ae967d9298356. Resources: {'key_pairs'} {{(pid=125871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 03:53:58.110417 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.quota [None req-c9f3bb17-0068-4c22-9e05-c5888e787238 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Getting quotas for user 6faa4e226ad74685a5de6988b616b070 and project 4dcae38b1a3c47f2a80ae967d9298356. Resources: {'key_pairs'} {{(pid=125871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 03:53:58.382898 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-c9f3bb17-0068-4c22-9e05-c5888e787238 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.311713 Oct 17 03:53:58.386470 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 11/21] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 17 03:53:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:54:01.032091 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-61568778-5d19-47de-b406-b3552cafd69f tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1626839737", "imageRef": "add1979e-0a3b-4403-a8ae-8d9a7b045fc2", "flavorRef": "452", "networks": [{"uuid": "d91e6fc6-d47b-4307-a9d1-02f4c60353c1"}]}} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:54:01.121004 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-5d1ec92b-89d7-4f3a-9717-dcf4b254b58f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1904955469", "imageRef": "add1979e-0a3b-4403-a8ae-8d9a7b045fc2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:54:01.226254 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.network.neutron [None req-61568778-5d19-47de-b406-b3552cafd69f tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] validate_networks() for [('d91e6fc6-d47b-4307-a9d1-02f4c60353c1', None, None, None, None, None)] {{(pid=125872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 03:54:01.324246 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.network.neutron [None req-5d1ec92b-89d7-4f3a-9717-dcf4b254b58f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] validate_networks() for [('f8073287-4612-43ec-a52d-7596b10ea924', None, None, None, None, None)] {{(pid=125871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 03:54:03.674876 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.virt.hardware [None req-61568778-5d19-47de-b406-b3552cafd69f tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Flavor limits 0:0:0 {{(pid=125872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 03:54:03.675498 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.virt.hardware [None req-61568778-5d19-47de-b406-b3552cafd69f tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Image limits 0:0:0 {{(pid=125872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 03:54:03.676074 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.virt.hardware [None req-61568778-5d19-47de-b406-b3552cafd69f tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Flavor pref 0:0:0 {{(pid=125872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 03:54:03.676515 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.virt.hardware [None req-61568778-5d19-47de-b406-b3552cafd69f tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Image pref 0:0:0 {{(pid=125872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 03:54:03.676920 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.virt.hardware [None req-61568778-5d19-47de-b406-b3552cafd69f tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 03:54:03.700734 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-61568778-5d19-47de-b406-b3552cafd69f tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:03.701456 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-61568778-5d19-47de-b406-b3552cafd69f tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:03.702058 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-61568778-5d19-47de-b406-b3552cafd69f tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:03.702965 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-61568778-5d19-47de-b406-b3552cafd69f tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:03.709461 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-61568778-5d19-47de-b406-b3552cafd69f tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:03.709461 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-61568778-5d19-47de-b406-b3552cafd69f tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:03.762513 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.quota [None req-61568778-5d19-47de-b406-b3552cafd69f tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Getting quotas for project 1b4043f98c7544df8d2ad8152faf5299. Resources: {'cores', 'instances', 'ram'} {{(pid=125872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 03:54:03.772218 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.quota [None req-61568778-5d19-47de-b406-b3552cafd69f tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Getting quotas for user 6fc1a698f79642088bb13b3b40d25dc2 and project 1b4043f98c7544df8d2ad8152faf5299. Resources: {'cores', 'instances', 'ram'} {{(pid=125872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 03:54:03.809114 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-61568778-5d19-47de-b406-b3552cafd69f tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Going to run 1 instances... {{(pid=125872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 03:54:03.813709 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-61568778-5d19-47de-b406-b3552cafd69f tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] [instance: b2c3871a-d117-4e6c-99c5-14777380ba38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='add1979e-0a3b-4403-a8ae-8d9a7b045fc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 03:54:03.848392 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.virt.hardware [None req-5d1ec92b-89d7-4f3a-9717-dcf4b254b58f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Flavor limits 0:0:0 {{(pid=125871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 03:54:03.849581 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.virt.hardware [None req-5d1ec92b-89d7-4f3a-9717-dcf4b254b58f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Image limits 0:0:0 {{(pid=125871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 03:54:03.850279 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.virt.hardware [None req-5d1ec92b-89d7-4f3a-9717-dcf4b254b58f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Flavor pref 0:0:0 {{(pid=125871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 03:54:03.850975 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.virt.hardware [None req-5d1ec92b-89d7-4f3a-9717-dcf4b254b58f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Image pref 0:0:0 {{(pid=125871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 03:54:03.851578 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.virt.hardware [None req-5d1ec92b-89d7-4f3a-9717-dcf4b254b58f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 03:54:03.877046 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5d1ec92b-89d7-4f3a-9717-dcf4b254b58f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:03.879872 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5d1ec92b-89d7-4f3a-9717-dcf4b254b58f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:03.882625 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5d1ec92b-89d7-4f3a-9717-dcf4b254b58f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:03.884149 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5d1ec92b-89d7-4f3a-9717-dcf4b254b58f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:03.886572 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5d1ec92b-89d7-4f3a-9717-dcf4b254b58f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:03.888750 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5d1ec92b-89d7-4f3a-9717-dcf4b254b58f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:03.987456 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.quota [None req-5d1ec92b-89d7-4f3a-9717-dcf4b254b58f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Getting quotas for project b033d35610f34401a99b912f145eb317. Resources: {'cores', 'instances', 'ram'} {{(pid=125871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 03:54:04.000616 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.quota [None req-5d1ec92b-89d7-4f3a-9717-dcf4b254b58f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Getting quotas for user fa0a6947667d48bfabf6aefad09c8325 and project b033d35610f34401a99b912f145eb317. Resources: {'cores', 'instances', 'ram'} {{(pid=125871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 03:54:04.061119 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-5d1ec92b-89d7-4f3a-9717-dcf4b254b58f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Going to run 1 instances... {{(pid=125871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 03:54:04.073751 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-61568778-5d19-47de-b406-b3552cafd69f tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.418661 Oct 17 03:54:04.084636 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-5d1ec92b-89d7-4f3a-9717-dcf4b254b58f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 06e9c5ca-8770-4ed5-90ae-bad248ab7ff7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='add1979e-0a3b-4403-a8ae-8d9a7b045fc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 03:54:04.090571 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 11/22] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 17 03:54:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 3436 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 03:54:04.122578 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-afd21be4-9160-4c31-aa4f-41aa9649ff8f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1049922509", "imageRef": "add1979e-0a3b-4403-a8ae-8d9a7b045fc2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "08dcfdbc-aaeb-49ae-86ff-471831242857"}], "security_groups": [{"name": "tempest-securitygroup--434631190"}], "key_name": "tempest-keypair-775223072", "user_data": "}} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:54:04.335438 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-5d1ec92b-89d7-4f3a-9717-dcf4b254b58f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.644640 Oct 17 03:54:04.335438 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 12/23] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 17 03:54:00 2022] POST /compute/v2.1/servers => generated 383 bytes in 3650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 03:54:04.372989 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-ffa85b42-eac9-4d48-ae57-539688f3c708 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:04.375588 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-ffa85b42-eac9-4d48-ae57-539688f3c708 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] [instance: b2c3871a-d117-4e6c-99c5-14777380ba38] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:04.499502 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.network.neutron [None req-afd21be4-9160-4c31-aa4f-41aa9649ff8f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] validate_networks() for [('08dcfdbc-aaeb-49ae-86ff-471831242857', None, None, None, None, None)] {{(pid=125872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 03:54:04.764419 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-ffa85b42-eac9-4d48-ae57-539688f3c708 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc1a698f79642088bb13b3b40d25dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4043f98c7544df8d2ad8152faf5299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:04.808184 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-ffa85b42-eac9-4d48-ae57-539688f3c708 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] 10.222.0.16 "GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38" status: 200 len: 1215 microversion: 2.1 time: 0.459435 Oct 17 03:54:04.811784 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 13/24] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:04 2022] GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38 => generated 1215 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:04.837833 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-334d7087-6ccb-4772-866d-d00dc126c3b8 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:04.843752 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-334d7087-6ccb-4772-866d-d00dc126c3b8 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 06e9c5ca-8770-4ed5-90ae-bad248ab7ff7] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:05.061514 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-334d7087-6ccb-4772-866d-d00dc126c3b8 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:05.073461 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-334d7087-6ccb-4772-866d-d00dc126c3b8 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7" status: 200 len: 1222 microversion: 2.1 time: 0.256763 Oct 17 03:54:05.074049 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 14/25] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:04 2022] GET /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7 => generated 1222 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:05.471204 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.virt.hardware [None req-afd21be4-9160-4c31-aa4f-41aa9649ff8f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Flavor limits 0:0:0 {{(pid=125872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 03:54:05.471995 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.virt.hardware [None req-afd21be4-9160-4c31-aa4f-41aa9649ff8f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Image limits 0:0:0 {{(pid=125872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 03:54:05.472691 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.virt.hardware [None req-afd21be4-9160-4c31-aa4f-41aa9649ff8f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Flavor pref 0:0:0 {{(pid=125872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 03:54:05.473253 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.virt.hardware [None req-afd21be4-9160-4c31-aa4f-41aa9649ff8f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Image pref 0:0:0 {{(pid=125872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 03:54:05.473815 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.virt.hardware [None req-afd21be4-9160-4c31-aa4f-41aa9649ff8f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 03:54:05.497899 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-afd21be4-9160-4c31-aa4f-41aa9649ff8f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:05.498740 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-afd21be4-9160-4c31-aa4f-41aa9649ff8f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:05.500735 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-afd21be4-9160-4c31-aa4f-41aa9649ff8f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:05.502857 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-afd21be4-9160-4c31-aa4f-41aa9649ff8f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:05.503986 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-afd21be4-9160-4c31-aa4f-41aa9649ff8f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:05.504643 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-afd21be4-9160-4c31-aa4f-41aa9649ff8f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:05.544444 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.quota [None req-afd21be4-9160-4c31-aa4f-41aa9649ff8f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Getting quotas for project 8af3ce80f169473882a247ba78d3d6ef. Resources: {'cores', 'instances', 'ram'} {{(pid=125872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 03:54:05.550116 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.quota [None req-afd21be4-9160-4c31-aa4f-41aa9649ff8f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Getting quotas for user e9ac14bb6ceb4d9a92a20938e9688bbd and project 8af3ce80f169473882a247ba78d3d6ef. Resources: {'cores', 'instances', 'ram'} {{(pid=125872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 03:54:05.569816 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-afd21be4-9160-4c31-aa4f-41aa9649ff8f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Going to run 1 instances... {{(pid=125872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 03:54:05.572201 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-afd21be4-9160-4c31-aa4f-41aa9649ff8f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: ff49fd54-9ddf-415d-8eb4-fb1b0bef634c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='add1979e-0a3b-4403-a8ae-8d9a7b045fc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 03:54:05.639910 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-b7730b3f-e1bd-4434-acb8-69066d794698 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2020230452", "imageRef": "add1979e-0a3b-4403-a8ae-8d9a7b045fc2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:54:05.771422 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-afd21be4-9160-4c31-aa4f-41aa9649ff8f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.673447 Oct 17 03:54:05.778357 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 12/26] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 17 03:54:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 1682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 03:54:05.790980 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.network.neutron [None req-b7730b3f-e1bd-4434-acb8-69066d794698 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] validate_networks() for [('f8073287-4612-43ec-a52d-7596b10ea924', None, None, None, None, None)] {{(pid=125871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 03:54:05.803653 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-2f37ca0a-8824-4223-ab09-07727b4b5d84 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:05.805744 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-2f37ca0a-8824-4223-ab09-07727b4b5d84 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: ff49fd54-9ddf-415d-8eb4-fb1b0bef634c] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:06.324485 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-2f37ca0a-8824-4223-ab09-07727b4b5d84 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:06.366815 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-2f37ca0a-8824-4223-ab09-07727b4b5d84 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c" status: 200 len: 1241 microversion: 2.1 time: 0.578028 Oct 17 03:54:06.389252 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 13/27] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:05 2022] GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c => generated 1241 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:06.418732 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-ba8b9b78-0772-40f1-bf5c-5da0a2420f5c tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:06.423670 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-ba8b9b78-0772-40f1-bf5c-5da0a2420f5c tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] [instance: b2c3871a-d117-4e6c-99c5-14777380ba38] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:06.528530 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-ba8b9b78-0772-40f1-bf5c-5da0a2420f5c tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc1a698f79642088bb13b3b40d25dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4043f98c7544df8d2ad8152faf5299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:06.532931 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-ba8b9b78-0772-40f1-bf5c-5da0a2420f5c tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] 10.222.0.16 "GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38" status: 200 len: 1215 microversion: 2.1 time: 0.144955 Oct 17 03:54:06.533719 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 14/28] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:06 2022] GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38 => generated 1215 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:06.539456 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-89eb9490-4659-4ee4-9f08-7a609170f6a3 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-240549967", "imageRef": "add1979e-0a3b-4403-a8ae-8d9a7b045fc2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6869a997-10fb-4abf-b4fa-a753fa0e6e23"}], "security_groups": [{"name": "tempest-securitygroup--1382997444"}], "key_name": "tempest-keypair-120723541", "user_data": "}} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:54:06.733544 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.network.neutron [None req-89eb9490-4659-4ee4-9f08-7a609170f6a3 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] validate_networks() for [('6869a997-10fb-4abf-b4fa-a753fa0e6e23', None, None, None, None, None)] {{(pid=125872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 03:54:07.158423 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.virt.hardware [None req-b7730b3f-e1bd-4434-acb8-69066d794698 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Flavor limits 0:0:0 {{(pid=125871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 03:54:07.159653 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.virt.hardware [None req-b7730b3f-e1bd-4434-acb8-69066d794698 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Image limits 0:0:0 {{(pid=125871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 03:54:07.160294 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.virt.hardware [None req-b7730b3f-e1bd-4434-acb8-69066d794698 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Flavor pref 0:0:0 {{(pid=125871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 03:54:07.160872 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.virt.hardware [None req-b7730b3f-e1bd-4434-acb8-69066d794698 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Image pref 0:0:0 {{(pid=125871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 03:54:07.161440 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.virt.hardware [None req-b7730b3f-e1bd-4434-acb8-69066d794698 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 03:54:07.175809 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b7730b3f-e1bd-4434-acb8-69066d794698 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:07.176575 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b7730b3f-e1bd-4434-acb8-69066d794698 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:07.177174 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b7730b3f-e1bd-4434-acb8-69066d794698 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:07.178045 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b7730b3f-e1bd-4434-acb8-69066d794698 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:07.178643 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b7730b3f-e1bd-4434-acb8-69066d794698 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:07.179245 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b7730b3f-e1bd-4434-acb8-69066d794698 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:07.198874 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.quota [None req-b7730b3f-e1bd-4434-acb8-69066d794698 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Getting quotas for project b033d35610f34401a99b912f145eb317. Resources: {'cores', 'instances', 'ram'} {{(pid=125871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 03:54:07.205149 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.quota [None req-b7730b3f-e1bd-4434-acb8-69066d794698 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Getting quotas for user fa0a6947667d48bfabf6aefad09c8325 and project b033d35610f34401a99b912f145eb317. Resources: {'cores', 'instances', 'ram'} {{(pid=125871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 03:54:07.218279 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-b7730b3f-e1bd-4434-acb8-69066d794698 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Going to run 1 instances... {{(pid=125871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 03:54:07.221001 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-b7730b3f-e1bd-4434-acb8-69066d794698 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 15a2e41f-4480-429c-9207-8d95daa186f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='add1979e-0a3b-4403-a8ae-8d9a7b045fc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 03:54:07.407935 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-b7730b3f-e1bd-4434-acb8-69066d794698 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.767330 Oct 17 03:54:07.408820 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 15/29] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 17 03:54:05 2022] POST /compute/v2.1/servers => generated 383 bytes in 1774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 03:54:07.413938 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-da9fe0f5-b504-413e-be2e-6cd127929544 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:07.417752 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-da9fe0f5-b504-413e-be2e-6cd127929544 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: ff49fd54-9ddf-415d-8eb4-fb1b0bef634c] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:07.598957 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.virt.hardware [None req-89eb9490-4659-4ee4-9f08-7a609170f6a3 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Flavor limits 0:0:0 {{(pid=125872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 03:54:07.599593 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.virt.hardware [None req-89eb9490-4659-4ee4-9f08-7a609170f6a3 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Image limits 0:0:0 {{(pid=125872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 03:54:07.600115 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.virt.hardware [None req-89eb9490-4659-4ee4-9f08-7a609170f6a3 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Flavor pref 0:0:0 {{(pid=125872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 03:54:07.600539 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.virt.hardware [None req-89eb9490-4659-4ee4-9f08-7a609170f6a3 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Image pref 0:0:0 {{(pid=125872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 03:54:07.600988 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.virt.hardware [None req-89eb9490-4659-4ee4-9f08-7a609170f6a3 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 03:54:07.618078 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-da9fe0f5-b504-413e-be2e-6cd127929544 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:07.651366 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-da9fe0f5-b504-413e-be2e-6cd127929544 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c" status: 200 len: 1241 microversion: 2.1 time: 0.229040 Oct 17 03:54:07.653863 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 16/30] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:07 2022] GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c => generated 1241 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:07.669565 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-89eb9490-4659-4ee4-9f08-7a609170f6a3 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:07.671258 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-d05be8dd-b646-4212-9139-4e2c3e65e781 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:07.672513 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-d05be8dd-b646-4212-9139-4e2c3e65e781 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 15a2e41f-4480-429c-9207-8d95daa186f5] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:07.673206 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-89eb9490-4659-4ee4-9f08-7a609170f6a3 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:07.673864 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-89eb9490-4659-4ee4-9f08-7a609170f6a3 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:07.676457 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-89eb9490-4659-4ee4-9f08-7a609170f6a3 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:07.677162 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-89eb9490-4659-4ee4-9f08-7a609170f6a3 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:07.679626 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-89eb9490-4659-4ee4-9f08-7a609170f6a3 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:07.748458 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.quota [None req-89eb9490-4659-4ee4-9f08-7a609170f6a3 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Getting quotas for project 4dcae38b1a3c47f2a80ae967d9298356. Resources: {'cores', 'instances', 'ram'} {{(pid=125872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 03:54:07.788960 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.quota [None req-89eb9490-4659-4ee4-9f08-7a609170f6a3 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Getting quotas for user 6faa4e226ad74685a5de6988b616b070 and project 4dcae38b1a3c47f2a80ae967d9298356. Resources: {'cores', 'instances', 'ram'} {{(pid=125872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 03:54:07.845544 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-89eb9490-4659-4ee4-9f08-7a609170f6a3 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Going to run 1 instances... {{(pid=125872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 03:54:07.854942 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-89eb9490-4659-4ee4-9f08-7a609170f6a3 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='add1979e-0a3b-4403-a8ae-8d9a7b045fc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 03:54:07.891433 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-d05be8dd-b646-4212-9139-4e2c3e65e781 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:07.913716 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-d05be8dd-b646-4212-9139-4e2c3e65e781 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5" status: 200 len: 1222 microversion: 2.1 time: 0.258586 Oct 17 03:54:07.914310 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 17/31] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:07 2022] GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5 => generated 1222 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:07.949298 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-b5a06074-bd41-402d-818d-bcdd24676618 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:07.951811 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-b5a06074-bd41-402d-818d-bcdd24676618 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] [instance: b2c3871a-d117-4e6c-99c5-14777380ba38] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:07.965756 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b5a06074-bd41-402d-818d-bcdd24676618 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:07.969261 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b5a06074-bd41-402d-818d-bcdd24676618 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:07.969883 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b5a06074-bd41-402d-818d-bcdd24676618 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:07.970901 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b5a06074-bd41-402d-818d-bcdd24676618 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:07.972570 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b5a06074-bd41-402d-818d-bcdd24676618 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:07.974631 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b5a06074-bd41-402d-818d-bcdd24676618 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:08.127154 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-89eb9490-4659-4ee4-9f08-7a609170f6a3 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.590985 Oct 17 03:54:08.128775 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 15/32] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 17 03:54:06 2022] POST /compute/v2.1/servers => generated 402 bytes in 1594 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 03:54:08.180033 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-3aff2f88-a560-4f0a-8e76-0a0a3f6777ad tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:08.182796 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-3aff2f88-a560-4f0a-8e76-0a0a3f6777ad tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:08.292960 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-b5a06074-bd41-402d-818d-bcdd24676618 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc1a698f79642088bb13b3b40d25dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4043f98c7544df8d2ad8152faf5299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:08.346906 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-b5a06074-bd41-402d-818d-bcdd24676618 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] 10.222.0.16 "GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38" status: 200 len: 1219 microversion: 2.1 time: 0.408483 Oct 17 03:54:08.346906 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 18/33] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:07 2022] GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38 => generated 1219 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:08.434996 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-3aff2f88-a560-4f0a-8e76-0a0a3f6777ad tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:08.450858 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-3aff2f88-a560-4f0a-8e76-0a0a3f6777ad tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1236 microversion: 2.1 time: 0.312526 Oct 17 03:54:08.451494 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 16/34] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:08 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1236 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:08.682052 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-da34bd8b-87b6-4496-8657-0e46b07e4c1e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:08.682914 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-da34bd8b-87b6-4496-8657-0e46b07e4c1e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: ff49fd54-9ddf-415d-8eb4-fb1b0bef634c] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:08.694744 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-da34bd8b-87b6-4496-8657-0e46b07e4c1e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:08.696569 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-da34bd8b-87b6-4496-8657-0e46b07e4c1e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:08.697023 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-da34bd8b-87b6-4496-8657-0e46b07e4c1e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:08.700947 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-da34bd8b-87b6-4496-8657-0e46b07e4c1e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:08.701433 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-da34bd8b-87b6-4496-8657-0e46b07e4c1e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:08.703630 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-da34bd8b-87b6-4496-8657-0e46b07e4c1e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:08.842379 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-da34bd8b-87b6-4496-8657-0e46b07e4c1e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:08.857316 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-da34bd8b-87b6-4496-8657-0e46b07e4c1e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c" status: 200 len: 1237 microversion: 2.1 time: 0.179042 Oct 17 03:54:08.857926 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 19/35] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:08 2022] GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c => generated 1237 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:08.943493 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-377c2492-80fb-4f69-a3cf-a6a458d8d6c5 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:08.945127 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-377c2492-80fb-4f69-a3cf-a6a458d8d6c5 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 15a2e41f-4480-429c-9207-8d95daa186f5] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:08.997091 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-377c2492-80fb-4f69-a3cf-a6a458d8d6c5 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:09.004642 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-377c2492-80fb-4f69-a3cf-a6a458d8d6c5 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5" status: 200 len: 1222 microversion: 2.1 time: 0.065976 Oct 17 03:54:09.005358 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 17/36] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:08 2022] GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5 => generated 1222 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:09.369214 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-2f1261d1-9699-43c6-a2e1-8215a3a583b8 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:09.369948 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-2f1261d1-9699-43c6-a2e1-8215a3a583b8 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] [instance: b2c3871a-d117-4e6c-99c5-14777380ba38] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:09.379814 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2f1261d1-9699-43c6-a2e1-8215a3a583b8 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:09.380392 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2f1261d1-9699-43c6-a2e1-8215a3a583b8 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:09.383560 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2f1261d1-9699-43c6-a2e1-8215a3a583b8 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:09.388036 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2f1261d1-9699-43c6-a2e1-8215a3a583b8 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:09.389061 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2f1261d1-9699-43c6-a2e1-8215a3a583b8 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:09.390309 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2f1261d1-9699-43c6-a2e1-8215a3a583b8 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:09.479988 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-668e2dca-7fa8-4b0f-86ea-2ac69d1034d4 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:09.480607 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-668e2dca-7fa8-4b0f-86ea-2ac69d1034d4 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:09.559573 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-2f1261d1-9699-43c6-a2e1-8215a3a583b8 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc1a698f79642088bb13b3b40d25dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4043f98c7544df8d2ad8152faf5299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:09.579120 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-2f1261d1-9699-43c6-a2e1-8215a3a583b8 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] 10.222.0.16 "GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38" status: 200 len: 1267 microversion: 2.1 time: 0.208534 Oct 17 03:54:09.581487 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 20/37] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:09 2022] GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38 => generated 1267 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:09.639047 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-668e2dca-7fa8-4b0f-86ea-2ac69d1034d4 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:09.649255 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-668e2dca-7fa8-4b0f-86ea-2ac69d1034d4 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1236 microversion: 2.1 time: 0.173502 Oct 17 03:54:09.661717 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 18/38] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:09 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1236 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:54:09.884754 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-ff23c0d2-91da-40f1-b444-24a7bab24382 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:09.885475 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-ff23c0d2-91da-40f1-b444-24a7bab24382 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: ff49fd54-9ddf-415d-8eb4-fb1b0bef634c] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:09.907575 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ff23c0d2-91da-40f1-b444-24a7bab24382 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:09.908419 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ff23c0d2-91da-40f1-b444-24a7bab24382 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:09.909730 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ff23c0d2-91da-40f1-b444-24a7bab24382 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:09.910738 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ff23c0d2-91da-40f1-b444-24a7bab24382 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:09.911533 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ff23c0d2-91da-40f1-b444-24a7bab24382 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:09.912176 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ff23c0d2-91da-40f1-b444-24a7bab24382 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:10.027738 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-6da41907-1241-4c91-b47f-2cd8c4b07f5c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:10.028560 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-6da41907-1241-4c91-b47f-2cd8c4b07f5c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 15a2e41f-4480-429c-9207-8d95daa186f5] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:10.047872 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6da41907-1241-4c91-b47f-2cd8c4b07f5c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:10.048656 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6da41907-1241-4c91-b47f-2cd8c4b07f5c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:10.051369 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6da41907-1241-4c91-b47f-2cd8c4b07f5c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:10.052311 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6da41907-1241-4c91-b47f-2cd8c4b07f5c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:10.052963 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6da41907-1241-4c91-b47f-2cd8c4b07f5c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:10.053661 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6da41907-1241-4c91-b47f-2cd8c4b07f5c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:10.068168 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-ff23c0d2-91da-40f1-b444-24a7bab24382 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:10.087014 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-ff23c0d2-91da-40f1-b444-24a7bab24382 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c" status: 200 len: 1293 microversion: 2.1 time: 0.204358 Oct 17 03:54:10.095449 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 21/39] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:09 2022] GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c => generated 1293 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:10.356634 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-6da41907-1241-4c91-b47f-2cd8c4b07f5c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:10.383567 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-6da41907-1241-4c91-b47f-2cd8c4b07f5c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5" status: 200 len: 1218 microversion: 2.1 time: 0.358248 Oct 17 03:54:10.385844 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 19/40] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:10 2022] GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5 => generated 1218 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:10.608261 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-f5dea76e-a00e-49d6-b21e-27716c375642 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:10.609758 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-f5dea76e-a00e-49d6-b21e-27716c375642 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] [instance: b2c3871a-d117-4e6c-99c5-14777380ba38] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:10.616967 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f5dea76e-a00e-49d6-b21e-27716c375642 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:10.618097 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f5dea76e-a00e-49d6-b21e-27716c375642 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:10.618724 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f5dea76e-a00e-49d6-b21e-27716c375642 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:10.619661 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f5dea76e-a00e-49d6-b21e-27716c375642 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:10.620319 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f5dea76e-a00e-49d6-b21e-27716c375642 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:10.621065 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f5dea76e-a00e-49d6-b21e-27716c375642 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:10.696548 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-db99fc15-ec51-4bbd-acff-4fcf0950b70f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:10.697515 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-db99fc15-ec51-4bbd-acff-4fcf0950b70f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:10.710729 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-db99fc15-ec51-4bbd-acff-4fcf0950b70f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:10.711854 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-db99fc15-ec51-4bbd-acff-4fcf0950b70f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:10.712558 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-db99fc15-ec51-4bbd-acff-4fcf0950b70f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:10.713960 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-db99fc15-ec51-4bbd-acff-4fcf0950b70f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:10.715101 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-db99fc15-ec51-4bbd-acff-4fcf0950b70f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:10.716022 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-db99fc15-ec51-4bbd-acff-4fcf0950b70f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:10.833041 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-f5dea76e-a00e-49d6-b21e-27716c375642 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc1a698f79642088bb13b3b40d25dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4043f98c7544df8d2ad8152faf5299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:10.846239 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-f5dea76e-a00e-49d6-b21e-27716c375642 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] 10.222.0.16 "GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38" status: 200 len: 1273 microversion: 2.1 time: 0.242558 Oct 17 03:54:10.851550 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 22/41] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:10 2022] GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38 => generated 1273 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:10.890187 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-db99fc15-ec51-4bbd-acff-4fcf0950b70f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:10.903828 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-db99fc15-ec51-4bbd-acff-4fcf0950b70f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1232 microversion: 2.1 time: 0.215202 Oct 17 03:54:10.919200 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 20/42] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:10 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1232 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:11.114008 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-e94f5404-401a-4fad-a9df-cc813a89e02b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:11.114550 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-e94f5404-401a-4fad-a9df-cc813a89e02b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: ff49fd54-9ddf-415d-8eb4-fb1b0bef634c] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:11.123205 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e94f5404-401a-4fad-a9df-cc813a89e02b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:11.123705 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e94f5404-401a-4fad-a9df-cc813a89e02b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:11.124138 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e94f5404-401a-4fad-a9df-cc813a89e02b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:11.124989 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e94f5404-401a-4fad-a9df-cc813a89e02b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:11.125463 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e94f5404-401a-4fad-a9df-cc813a89e02b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:11.125886 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e94f5404-401a-4fad-a9df-cc813a89e02b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:11.257318 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-e94f5404-401a-4fad-a9df-cc813a89e02b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:11.274941 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-e94f5404-401a-4fad-a9df-cc813a89e02b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c" status: 200 len: 1301 microversion: 2.1 time: 0.164700 Oct 17 03:54:11.275601 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 23/43] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:11 2022] GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c => generated 1301 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:54:11.410994 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-f4827ac1-6022-45eb-bfb5-96d361b13127 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:11.412086 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-f4827ac1-6022-45eb-bfb5-96d361b13127 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 15a2e41f-4480-429c-9207-8d95daa186f5] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:11.424849 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f4827ac1-6022-45eb-bfb5-96d361b13127 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:11.425432 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f4827ac1-6022-45eb-bfb5-96d361b13127 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:11.426187 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f4827ac1-6022-45eb-bfb5-96d361b13127 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:11.428157 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f4827ac1-6022-45eb-bfb5-96d361b13127 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:11.429880 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f4827ac1-6022-45eb-bfb5-96d361b13127 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:11.430548 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f4827ac1-6022-45eb-bfb5-96d361b13127 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:11.768465 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-f4827ac1-6022-45eb-bfb5-96d361b13127 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:11.797735 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-f4827ac1-6022-45eb-bfb5-96d361b13127 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5" status: 200 len: 1218 microversion: 2.1 time: 0.392074 Oct 17 03:54:11.800411 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 21/44] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:11 2022] GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5 => generated 1218 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:11.872123 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-368c38cd-9453-4962-9c77-0a738c1a20b5 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:11.872686 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-368c38cd-9453-4962-9c77-0a738c1a20b5 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] [instance: b2c3871a-d117-4e6c-99c5-14777380ba38] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:11.895794 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-368c38cd-9453-4962-9c77-0a738c1a20b5 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:11.898196 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-368c38cd-9453-4962-9c77-0a738c1a20b5 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:11.898196 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-368c38cd-9453-4962-9c77-0a738c1a20b5 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:11.898196 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-368c38cd-9453-4962-9c77-0a738c1a20b5 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:11.898196 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-368c38cd-9453-4962-9c77-0a738c1a20b5 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:11.898591 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-368c38cd-9453-4962-9c77-0a738c1a20b5 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:11.933533 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-08b287eb-e88c-44fc-9f56-523073651c8d tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:11.934382 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-08b287eb-e88c-44fc-9f56-523073651c8d tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:11.957836 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-08b287eb-e88c-44fc-9f56-523073651c8d tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:11.961428 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-08b287eb-e88c-44fc-9f56-523073651c8d tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:11.962167 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-08b287eb-e88c-44fc-9f56-523073651c8d tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:11.967553 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-08b287eb-e88c-44fc-9f56-523073651c8d tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:11.971403 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-08b287eb-e88c-44fc-9f56-523073651c8d tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:11.972790 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-08b287eb-e88c-44fc-9f56-523073651c8d tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:12.216845 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-368c38cd-9453-4962-9c77-0a738c1a20b5 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc1a698f79642088bb13b3b40d25dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4043f98c7544df8d2ad8152faf5299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:12.225201 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-368c38cd-9453-4962-9c77-0a738c1a20b5 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] 10.222.0.16 "GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38" status: 200 len: 1315 microversion: 2.1 time: 0.357657 Oct 17 03:54:12.225775 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 24/45] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:11 2022] GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38 => generated 1315 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:12.304036 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-261e8bb9-f4cf-4260-b39a-75da3f7f7224 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:12.308357 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-261e8bb9-f4cf-4260-b39a-75da3f7f7224 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: ff49fd54-9ddf-415d-8eb4-fb1b0bef634c] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:12.311614 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-261e8bb9-f4cf-4260-b39a-75da3f7f7224 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:12.315835 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-261e8bb9-f4cf-4260-b39a-75da3f7f7224 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:12.318036 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-261e8bb9-f4cf-4260-b39a-75da3f7f7224 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:12.331850 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-261e8bb9-f4cf-4260-b39a-75da3f7f7224 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:12.335470 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-261e8bb9-f4cf-4260-b39a-75da3f7f7224 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:12.336331 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-261e8bb9-f4cf-4260-b39a-75da3f7f7224 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:12.457786 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-08b287eb-e88c-44fc-9f56-523073651c8d tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:12.466961 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-08b287eb-e88c-44fc-9f56-523073651c8d tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1232 microversion: 2.1 time: 0.538362 Oct 17 03:54:12.479701 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 22/46] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:11 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1232 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:54:12.681628 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-261e8bb9-f4cf-4260-b39a-75da3f7f7224 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:12.690749 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-261e8bb9-f4cf-4260-b39a-75da3f7f7224 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c" status: 200 len: 1299 microversion: 2.1 time: 0.390904 Oct 17 03:54:12.698846 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 25/47] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:12 2022] GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c => generated 1299 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:12.830504 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-4591ba76-bc13-45c2-8019-8ef9e4c548f7 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:12.830504 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-4591ba76-bc13-45c2-8019-8ef9e4c548f7 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 15a2e41f-4480-429c-9207-8d95daa186f5] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:12.838545 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-4591ba76-bc13-45c2-8019-8ef9e4c548f7 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:12.839048 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-4591ba76-bc13-45c2-8019-8ef9e4c548f7 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:12.839517 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-4591ba76-bc13-45c2-8019-8ef9e4c548f7 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:12.844216 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-4591ba76-bc13-45c2-8019-8ef9e4c548f7 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:12.844919 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-4591ba76-bc13-45c2-8019-8ef9e4c548f7 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:12.845886 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-4591ba76-bc13-45c2-8019-8ef9e4c548f7 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:13.250167 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-29d5c5b0-c5af-4e27-a1a2-a658b071bd5a tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:13.250966 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-29d5c5b0-c5af-4e27-a1a2-a658b071bd5a tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] [instance: b2c3871a-d117-4e6c-99c5-14777380ba38] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:13.259790 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-29d5c5b0-c5af-4e27-a1a2-a658b071bd5a tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:13.268450 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-29d5c5b0-c5af-4e27-a1a2-a658b071bd5a tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:13.272199 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-29d5c5b0-c5af-4e27-a1a2-a658b071bd5a tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:13.274543 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-29d5c5b0-c5af-4e27-a1a2-a658b071bd5a tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:13.274543 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-29d5c5b0-c5af-4e27-a1a2-a658b071bd5a tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:13.279517 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-29d5c5b0-c5af-4e27-a1a2-a658b071bd5a tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:13.456417 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-4591ba76-bc13-45c2-8019-8ef9e4c548f7 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:13.469751 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-4591ba76-bc13-45c2-8019-8ef9e4c548f7 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5" status: 200 len: 1274 microversion: 2.1 time: 0.647359 Oct 17 03:54:13.472583 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 23/48] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:12 2022] GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5 => generated 1274 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:54:13.512250 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-cd4ac0fc-bb30-48bd-9e34-a3729af1850a tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:13.512891 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-cd4ac0fc-bb30-48bd-9e34-a3729af1850a tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:13.549523 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-cd4ac0fc-bb30-48bd-9e34-a3729af1850a tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:13.550068 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-cd4ac0fc-bb30-48bd-9e34-a3729af1850a tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:13.550525 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-cd4ac0fc-bb30-48bd-9e34-a3729af1850a tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:13.560913 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-cd4ac0fc-bb30-48bd-9e34-a3729af1850a tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:13.562854 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-cd4ac0fc-bb30-48bd-9e34-a3729af1850a tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:13.563353 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-cd4ac0fc-bb30-48bd-9e34-a3729af1850a tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:14.400412 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-cd4ac0fc-bb30-48bd-9e34-a3729af1850a tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:14.431593 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-cd4ac0fc-bb30-48bd-9e34-a3729af1850a tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1288 microversion: 2.1 time: 0.930802 Oct 17 03:54:14.433296 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 24/49] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:13 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1288 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:54:14.447920 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-76636ea3-b3aa-47e2-a708-1e8ef0ba58b4 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:14.449731 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-76636ea3-b3aa-47e2-a708-1e8ef0ba58b4 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: ff49fd54-9ddf-415d-8eb4-fb1b0bef634c] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:14.480498 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-76636ea3-b3aa-47e2-a708-1e8ef0ba58b4 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:14.481456 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-76636ea3-b3aa-47e2-a708-1e8ef0ba58b4 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:14.487598 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-76636ea3-b3aa-47e2-a708-1e8ef0ba58b4 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:14.491265 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-76636ea3-b3aa-47e2-a708-1e8ef0ba58b4 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:14.493624 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-76636ea3-b3aa-47e2-a708-1e8ef0ba58b4 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:14.494267 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-76636ea3-b3aa-47e2-a708-1e8ef0ba58b4 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:14.787949 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-29d5c5b0-c5af-4e27-a1a2-a658b071bd5a tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc1a698f79642088bb13b3b40d25dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4043f98c7544df8d2ad8152faf5299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:14.799148 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-29d5c5b0-c5af-4e27-a1a2-a658b071bd5a tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] 10.222.0.16 "GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38" status: 200 len: 1315 microversion: 2.1 time: 1.553081 Oct 17 03:54:14.819399 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 26/50] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:13 2022] GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38 => generated 1315 bytes in 1573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:54:14.830375 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-c9401fff-e834-46e0-a255-d32070bbbb25 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:14.831792 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-c9401fff-e834-46e0-a255-d32070bbbb25 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 15a2e41f-4480-429c-9207-8d95daa186f5] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:14.870902 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c9401fff-e834-46e0-a255-d32070bbbb25 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:14.875412 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c9401fff-e834-46e0-a255-d32070bbbb25 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:14.876166 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c9401fff-e834-46e0-a255-d32070bbbb25 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:14.877129 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c9401fff-e834-46e0-a255-d32070bbbb25 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:14.879609 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c9401fff-e834-46e0-a255-d32070bbbb25 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:14.880310 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c9401fff-e834-46e0-a255-d32070bbbb25 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:15.113506 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-76636ea3-b3aa-47e2-a708-1e8ef0ba58b4 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:15.133303 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-76636ea3-b3aa-47e2-a708-1e8ef0ba58b4 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c" status: 200 len: 1299 microversion: 2.1 time: 0.695068 Oct 17 03:54:15.134480 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 25/51] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:14 2022] GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c => generated 1299 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:15.460905 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-850a3978-58f1-4eef-8906-7ad60ff0440f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:15.461741 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-850a3978-58f1-4eef-8906-7ad60ff0440f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:15.485031 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:54:15.499307 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-850a3978-58f1-4eef-8906-7ad60ff0440f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:15.499893 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-850a3978-58f1-4eef-8906-7ad60ff0440f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:15.503964 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-850a3978-58f1-4eef-8906-7ad60ff0440f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:15.505226 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-850a3978-58f1-4eef-8906-7ad60ff0440f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:15.505904 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-850a3978-58f1-4eef-8906-7ad60ff0440f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:15.506390 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-850a3978-58f1-4eef-8906-7ad60ff0440f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:15.742988 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-c9401fff-e834-46e0-a255-d32070bbbb25 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:15.754209 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-c9401fff-e834-46e0-a255-d32070bbbb25 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5" status: 200 len: 1280 microversion: 2.1 time: 0.931608 Oct 17 03:54:15.757500 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 27/52] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:14 2022] GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5 => generated 1280 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:15.769253 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-850a3978-58f1-4eef-8906-7ad60ff0440f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:15.791006 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-850a3978-58f1-4eef-8906-7ad60ff0440f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1294 microversion: 2.1 time: 0.335794 Oct 17 03:54:15.792481 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 26/53] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:15 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1294 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:54:15.826473 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-0005b73e-cb48-4f0d-9fd9-a7b785267ee2 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:15.828397 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-0005b73e-cb48-4f0d-9fd9-a7b785267ee2 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] [instance: b2c3871a-d117-4e6c-99c5-14777380ba38] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:15.847540 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0005b73e-cb48-4f0d-9fd9-a7b785267ee2 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:15.849183 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0005b73e-cb48-4f0d-9fd9-a7b785267ee2 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:15.849617 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0005b73e-cb48-4f0d-9fd9-a7b785267ee2 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:15.851631 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0005b73e-cb48-4f0d-9fd9-a7b785267ee2 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:15.852088 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0005b73e-cb48-4f0d-9fd9-a7b785267ee2 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:15.855228 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0005b73e-cb48-4f0d-9fd9-a7b785267ee2 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:16.165749 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-d1d1fbd9-3c7b-4f3e-92a1-2a6f38e4bae3 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:16.166616 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-d1d1fbd9-3c7b-4f3e-92a1-2a6f38e4bae3 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: ff49fd54-9ddf-415d-8eb4-fb1b0bef634c] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:16.190417 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d1d1fbd9-3c7b-4f3e-92a1-2a6f38e4bae3 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:16.190911 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d1d1fbd9-3c7b-4f3e-92a1-2a6f38e4bae3 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:16.191372 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d1d1fbd9-3c7b-4f3e-92a1-2a6f38e4bae3 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:16.197757 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d1d1fbd9-3c7b-4f3e-92a1-2a6f38e4bae3 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:16.198408 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d1d1fbd9-3c7b-4f3e-92a1-2a6f38e4bae3 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:16.198857 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d1d1fbd9-3c7b-4f3e-92a1-2a6f38e4bae3 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:17.189091 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_cell0:SELECT=4 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:54:17.209247 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-d1d1fbd9-3c7b-4f3e-92a1-2a6f38e4bae3 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:17.225093 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-d1d1fbd9-3c7b-4f3e-92a1-2a6f38e4bae3 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c" status: 200 len: 1366 microversion: 2.1 time: 1.063976 Oct 17 03:54:17.225849 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 27/54] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:16 2022] GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c => generated 1366 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:54:17.270169 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-687118a3-ae49-49cb-abe2-831af5e881e2 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:17.276450 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-687118a3-ae49-49cb-abe2-831af5e881e2 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 15a2e41f-4480-429c-9207-8d95daa186f5] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:17.298585 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-687118a3-ae49-49cb-abe2-831af5e881e2 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:17.316426 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-687118a3-ae49-49cb-abe2-831af5e881e2 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:17.316872 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-687118a3-ae49-49cb-abe2-831af5e881e2 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:17.318087 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-687118a3-ae49-49cb-abe2-831af5e881e2 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:17.319706 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-687118a3-ae49-49cb-abe2-831af5e881e2 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:17.330291 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-687118a3-ae49-49cb-abe2-831af5e881e2 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:17.517927 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-687118a3-ae49-49cb-abe2-831af5e881e2 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:17.521688 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-0005b73e-cb48-4f0d-9fd9-a7b785267ee2 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc1a698f79642088bb13b3b40d25dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4043f98c7544df8d2ad8152faf5299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:17.530120 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-687118a3-ae49-49cb-abe2-831af5e881e2 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5" status: 200 len: 1280 microversion: 2.1 time: 0.278932 Oct 17 03:54:17.530778 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 28/55] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:17 2022] GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5 => generated 1280 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:17.535067 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-0005b73e-cb48-4f0d-9fd9-a7b785267ee2 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] 10.222.0.16 "GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38" status: 200 len: 1315 microversion: 2.1 time: 1.714108 Oct 17 03:54:17.549851 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-1f05523e-6f51-4bcd-8f19-23cf15437d0c tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:17.551804 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-1f05523e-6f51-4bcd-8f19-23cf15437d0c tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:17.559291 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 28/56] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:15 2022] GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38 => generated 1315 bytes in 1738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:17.573935 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1f05523e-6f51-4bcd-8f19-23cf15437d0c tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:17.575286 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1f05523e-6f51-4bcd-8f19-23cf15437d0c tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:17.578389 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1f05523e-6f51-4bcd-8f19-23cf15437d0c tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:17.585038 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1f05523e-6f51-4bcd-8f19-23cf15437d0c tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:17.587213 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1f05523e-6f51-4bcd-8f19-23cf15437d0c tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:17.588928 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1f05523e-6f51-4bcd-8f19-23cf15437d0c tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:17.698847 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_cell0:SELECT=6 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:54:17.743740 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-1f05523e-6f51-4bcd-8f19-23cf15437d0c tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:17.756101 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-1f05523e-6f51-4bcd-8f19-23cf15437d0c tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1294 microversion: 2.1 time: 0.224216 Oct 17 03:54:17.756947 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 29/57] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:17 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1294 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:18.255687 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-b8f66985-be7a-4724-941a-ef6ba53bca75 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:18.256815 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-b8f66985-be7a-4724-941a-ef6ba53bca75 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: ff49fd54-9ddf-415d-8eb4-fb1b0bef634c] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:18.274961 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_cell0:SELECT=24 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:54:18.280071 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b8f66985-be7a-4724-941a-ef6ba53bca75 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:18.282443 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b8f66985-be7a-4724-941a-ef6ba53bca75 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:18.283811 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b8f66985-be7a-4724-941a-ef6ba53bca75 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:18.305052 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b8f66985-be7a-4724-941a-ef6ba53bca75 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:18.307648 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b8f66985-be7a-4724-941a-ef6ba53bca75 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:18.311305 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b8f66985-be7a-4724-941a-ef6ba53bca75 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:18.559863 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-f3ee5902-a32c-4eab-96fb-c96fa6509529 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:18.560480 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-f3ee5902-a32c-4eab-96fb-c96fa6509529 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 15a2e41f-4480-429c-9207-8d95daa186f5] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:18.575402 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f3ee5902-a32c-4eab-96fb-c96fa6509529 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:18.576132 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f3ee5902-a32c-4eab-96fb-c96fa6509529 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:18.576727 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f3ee5902-a32c-4eab-96fb-c96fa6509529 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:18.579851 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f3ee5902-a32c-4eab-96fb-c96fa6509529 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:18.580505 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f3ee5902-a32c-4eab-96fb-c96fa6509529 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:18.581963 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f3ee5902-a32c-4eab-96fb-c96fa6509529 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:18.890936 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-f3ee5902-a32c-4eab-96fb-c96fa6509529 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:18.901350 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-f3ee5902-a32c-4eab-96fb-c96fa6509529 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5" status: 200 len: 1280 microversion: 2.1 time: 0.345671 Oct 17 03:54:18.902436 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 30/58] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:18 2022] GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5 => generated 1280 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:18.922520 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-985c0752-72f2-43c0-bccc-215c21b9c481 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:18.923238 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-985c0752-72f2-43c0-bccc-215c21b9c481 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] [instance: b2c3871a-d117-4e6c-99c5-14777380ba38] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:18.936368 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-985c0752-72f2-43c0-bccc-215c21b9c481 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:18.937262 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-985c0752-72f2-43c0-bccc-215c21b9c481 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:18.938192 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-985c0752-72f2-43c0-bccc-215c21b9c481 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:18.939248 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-985c0752-72f2-43c0-bccc-215c21b9c481 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:18.939988 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-985c0752-72f2-43c0-bccc-215c21b9c481 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:18.940555 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-985c0752-72f2-43c0-bccc-215c21b9c481 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:19.566937 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-b8f66985-be7a-4724-941a-ef6ba53bca75 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:19.581875 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-b8f66985-be7a-4724-941a-ef6ba53bca75 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c" status: 200 len: 1366 microversion: 2.1 time: 1.330623 Oct 17 03:54:19.584168 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 29/59] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:18 2022] GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c => generated 1366 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:19.598204 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-56b84a8c-b492-4ff8-83b3-550623d96302 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:19.602756 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-985c0752-72f2-43c0-bccc-215c21b9c481 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc1a698f79642088bb13b3b40d25dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4043f98c7544df8d2ad8152faf5299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:19.603305 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-56b84a8c-b492-4ff8-83b3-550623d96302 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:19.609561 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-985c0752-72f2-43c0-bccc-215c21b9c481 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] 10.222.0.16 "GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38" status: 200 len: 1315 microversion: 2.1 time: 0.705163 Oct 17 03:54:19.616132 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 31/60] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:18 2022] GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38 => generated 1315 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:19.631607 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-56b84a8c-b492-4ff8-83b3-550623d96302 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:19.631607 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-56b84a8c-b492-4ff8-83b3-550623d96302 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:19.631607 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-56b84a8c-b492-4ff8-83b3-550623d96302 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:19.631607 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-56b84a8c-b492-4ff8-83b3-550623d96302 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:19.641098 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-56b84a8c-b492-4ff8-83b3-550623d96302 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:19.642210 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-56b84a8c-b492-4ff8-83b3-550623d96302 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:19.644695 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_cell0:SELECT=32 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:54:19.789738 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [req-6c8e980f-42f6-4e69-8a7b-f34657f08d1f req-5a8c1871-c899-40c0-a07c-b5f1bbb31e3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2c3871a-d117-4e6c-99c5-14777380ba38", "tag": "10a4687c-7980-411a-8dd5-9ce3d9f6bad5"}]} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:54:19.809040 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-6c8e980f-42f6-4e69-8a7b-f34657f08d1f req-5a8c1871-c899-40c0-a07c-b5f1bbb31e3b service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:19.809846 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-6c8e980f-42f6-4e69-8a7b-f34657f08d1f req-5a8c1871-c899-40c0-a07c-b5f1bbb31e3b service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:19.810479 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-6c8e980f-42f6-4e69-8a7b-f34657f08d1f req-5a8c1871-c899-40c0-a07c-b5f1bbb31e3b service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:19.854549 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.compute.server_external_events [req-6c8e980f-42f6-4e69-8a7b-f34657f08d1f req-5a8c1871-c899-40c0-a07c-b5f1bbb31e3b service nova] Creating event network-changed:10a4687c-7980-411a-8dd5-9ce3d9f6bad5 for instance b2c3871a-d117-4e6c-99c5-14777380ba38 on hv-cinder-81558 Oct 17 03:54:19.855453 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-6c8e980f-42f6-4e69-8a7b-f34657f08d1f req-5a8c1871-c899-40c0-a07c-b5f1bbb31e3b service nova] Acquiring lock "compute-rpcapi-router" {{(pid=125872) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 17 03:54:19.856086 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-6c8e980f-42f6-4e69-8a7b-f34657f08d1f req-5a8c1871-c899-40c0-a07c-b5f1bbb31e3b service nova] Acquired lock "compute-rpcapi-router" {{(pid=125872) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 17 03:54:19.857374 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-544e5fd6-e930-4150-be51-f036037cfae4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:19.858048 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-544e5fd6-e930-4150-be51-f036037cfae4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:19.864574 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-544e5fd6-e930-4150-be51-f036037cfae4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:19.864574 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-544e5fd6-e930-4150-be51-f036037cfae4 None None] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:19.864574 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-544e5fd6-e930-4150-be51-f036037cfae4 None None] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:19.864574 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-544e5fd6-e930-4150-be51-f036037cfae4 None None] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:19.883737 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.compute.rpcapi [None req-544e5fd6-e930-4150-be51-f036037cfae4 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 17 03:54:19.884869 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-544e5fd6-e930-4150-be51-f036037cfae4 None None] Releasing lock "compute-rpcapi-router" {{(pid=125872) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 17 03:54:19.914746 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-544e5fd6-e930-4150-be51-f036037cfae4 None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.297060 Oct 17 03:54:19.916023 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 32/61] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 03:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:54:20.044154 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [req-9738bd8c-6618-4008-8de6-ed60a5c3d122 req-61e26a6c-07fe-4208-a548-e96258b24078 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff49fd54-9ddf-415d-8eb4-fb1b0bef634c", "tag": "f99713b4-2587-4880-bc02-eb025501171c"}]} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:54:20.070586 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-9738bd8c-6618-4008-8de6-ed60a5c3d122 req-61e26a6c-07fe-4208-a548-e96258b24078 service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:20.073131 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-9738bd8c-6618-4008-8de6-ed60a5c3d122 req-61e26a6c-07fe-4208-a548-e96258b24078 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:20.073833 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-9738bd8c-6618-4008-8de6-ed60a5c3d122 req-61e26a6c-07fe-4208-a548-e96258b24078 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:20.090533 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.compute.server_external_events [req-9738bd8c-6618-4008-8de6-ed60a5c3d122 req-61e26a6c-07fe-4208-a548-e96258b24078 service nova] Creating event network-changed:f99713b4-2587-4880-bc02-eb025501171c for instance ff49fd54-9ddf-415d-8eb4-fb1b0bef634c on hv-cinder-81558 Oct 17 03:54:20.100238 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [req-9738bd8c-6618-4008-8de6-ed60a5c3d122 req-61e26a6c-07fe-4208-a548-e96258b24078 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.182646 Oct 17 03:54:20.104407 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 33/62] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 03:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:54:20.112123 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-4a17fb7f-be93-484f-9bcf-90bead7156f5 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:20.118743 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-4a17fb7f-be93-484f-9bcf-90bead7156f5 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 15a2e41f-4480-429c-9207-8d95daa186f5] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:20.142996 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-4a17fb7f-be93-484f-9bcf-90bead7156f5 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:20.143542 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-4a17fb7f-be93-484f-9bcf-90bead7156f5 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:20.143994 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-4a17fb7f-be93-484f-9bcf-90bead7156f5 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:20.144710 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-4a17fb7f-be93-484f-9bcf-90bead7156f5 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:20.145168 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-4a17fb7f-be93-484f-9bcf-90bead7156f5 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:20.145598 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-4a17fb7f-be93-484f-9bcf-90bead7156f5 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:20.660600 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-56b84a8c-b492-4ff8-83b3-550623d96302 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:20.672560 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-56b84a8c-b492-4ff8-83b3-550623d96302 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1362 microversion: 2.1 time: 1.083640 Oct 17 03:54:20.673282 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 30/63] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:19 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1362 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:20.700417 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-83302a86-d5bd-4986-83fb-d62107d38d6e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:20.701131 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-83302a86-d5bd-4986-83fb-d62107d38d6e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: ff49fd54-9ddf-415d-8eb4-fb1b0bef634c] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:20.715688 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-83302a86-d5bd-4986-83fb-d62107d38d6e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:20.716673 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-83302a86-d5bd-4986-83fb-d62107d38d6e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:20.717324 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-83302a86-d5bd-4986-83fb-d62107d38d6e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:20.718769 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-83302a86-d5bd-4986-83fb-d62107d38d6e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:20.719584 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-83302a86-d5bd-4986-83fb-d62107d38d6e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:20.721683 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-83302a86-d5bd-4986-83fb-d62107d38d6e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:20.854415 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-4a17fb7f-be93-484f-9bcf-90bead7156f5 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:20.976287 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-4a17fb7f-be93-484f-9bcf-90bead7156f5 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5" status: 200 len: 1322 microversion: 2.1 time: 0.865591 Oct 17 03:54:20.980454 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 34/64] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:20 2022] GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5 => generated 1322 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:21.005169 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-28950c57-66c3-4108-b097-f96bf382b083 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:21.011443 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-28950c57-66c3-4108-b097-f96bf382b083 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] [instance: b2c3871a-d117-4e6c-99c5-14777380ba38] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:21.055734 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-28950c57-66c3-4108-b097-f96bf382b083 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:21.056508 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-28950c57-66c3-4108-b097-f96bf382b083 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:21.063775 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-28950c57-66c3-4108-b097-f96bf382b083 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:21.063775 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-28950c57-66c3-4108-b097-f96bf382b083 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:21.063775 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-28950c57-66c3-4108-b097-f96bf382b083 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:21.065457 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-28950c57-66c3-4108-b097-f96bf382b083 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:21.144260 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_cell1:SELECT=100 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:54:21.199722 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-83302a86-d5bd-4986-83fb-d62107d38d6e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:21.217452 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-83302a86-d5bd-4986-83fb-d62107d38d6e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c" status: 200 len: 1366 microversion: 2.1 time: 0.528405 Oct 17 03:54:21.227477 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 31/65] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:20 2022] GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c => generated 1366 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:21.600098 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-28950c57-66c3-4108-b097-f96bf382b083 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc1a698f79642088bb13b3b40d25dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4043f98c7544df8d2ad8152faf5299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:21.613047 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-28950c57-66c3-4108-b097-f96bf382b083 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] 10.222.0.16 "GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38" status: 200 len: 1315 microversion: 2.1 time: 0.627027 Oct 17 03:54:21.621112 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 35/66] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:20 2022] GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38 => generated 1315 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:21.704950 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-e4d67f90-aea4-4313-b1d6-01f2f7d02635 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:21.709375 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-e4d67f90-aea4-4313-b1d6-01f2f7d02635 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:21.724843 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e4d67f90-aea4-4313-b1d6-01f2f7d02635 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:21.730230 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e4d67f90-aea4-4313-b1d6-01f2f7d02635 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:21.733309 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e4d67f90-aea4-4313-b1d6-01f2f7d02635 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:21.735023 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e4d67f90-aea4-4313-b1d6-01f2f7d02635 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:21.738030 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e4d67f90-aea4-4313-b1d6-01f2f7d02635 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:21.740070 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e4d67f90-aea4-4313-b1d6-01f2f7d02635 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:22.005919 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-24c36fe4-ee28-47a9-bf31-2cb00a55378a tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:22.007395 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-24c36fe4-ee28-47a9-bf31-2cb00a55378a tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 15a2e41f-4480-429c-9207-8d95daa186f5] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:22.018059 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-24c36fe4-ee28-47a9-bf31-2cb00a55378a tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:22.021100 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-24c36fe4-ee28-47a9-bf31-2cb00a55378a tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:22.022201 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-24c36fe4-ee28-47a9-bf31-2cb00a55378a tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:22.026894 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-24c36fe4-ee28-47a9-bf31-2cb00a55378a tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:22.027784 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-24c36fe4-ee28-47a9-bf31-2cb00a55378a tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:22.028390 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-24c36fe4-ee28-47a9-bf31-2cb00a55378a tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:22.625470 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-24c36fe4-ee28-47a9-bf31-2cb00a55378a tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:22.637747 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-24c36fe4-ee28-47a9-bf31-2cb00a55378a tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5" status: 200 len: 1322 microversion: 2.1 time: 0.636769 Oct 17 03:54:22.640364 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 36/67] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:21 2022] GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5 => generated 1322 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:22.646871 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [req-faeeed6a-0aa7-4a2f-9984-34ec246f3b69 req-d2aeeec8-4b1e-43c4-990b-ddc6ac8f7710 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06e9c5ca-8770-4ed5-90ae-bad248ab7ff7", "tag": "2e6c9011-7760-4042-9cfb-b70dfe1712a5"}]} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:54:22.688709 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-faeeed6a-0aa7-4a2f-9984-34ec246f3b69 req-d2aeeec8-4b1e-43c4-990b-ddc6ac8f7710 service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:22.689525 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-faeeed6a-0aa7-4a2f-9984-34ec246f3b69 req-d2aeeec8-4b1e-43c4-990b-ddc6ac8f7710 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:22.690173 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-faeeed6a-0aa7-4a2f-9984-34ec246f3b69 req-d2aeeec8-4b1e-43c4-990b-ddc6ac8f7710 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:22.704921 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.compute.server_external_events [req-faeeed6a-0aa7-4a2f-9984-34ec246f3b69 req-d2aeeec8-4b1e-43c4-990b-ddc6ac8f7710 service nova] Creating event network-changed:2e6c9011-7760-4042-9cfb-b70dfe1712a5 for instance 06e9c5ca-8770-4ed5-90ae-bad248ab7ff7 on hv-cinder-81558 Oct 17 03:54:22.710176 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [req-faeeed6a-0aa7-4a2f-9984-34ec246f3b69 req-d2aeeec8-4b1e-43c4-990b-ddc6ac8f7710 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068444 Oct 17 03:54:22.711351 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 37/68] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 03:54:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:54:22.717683 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-6275b768-2a43-4897-87ba-7725d1794530 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:22.719539 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-6275b768-2a43-4897-87ba-7725d1794530 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: ff49fd54-9ddf-415d-8eb4-fb1b0bef634c] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:22.741899 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6275b768-2a43-4897-87ba-7725d1794530 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:22.742707 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6275b768-2a43-4897-87ba-7725d1794530 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:22.743449 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6275b768-2a43-4897-87ba-7725d1794530 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:22.744849 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6275b768-2a43-4897-87ba-7725d1794530 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:22.745521 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6275b768-2a43-4897-87ba-7725d1794530 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:22.746201 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6275b768-2a43-4897-87ba-7725d1794530 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:23.166192 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-6275b768-2a43-4897-87ba-7725d1794530 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:23.180208 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-e4d67f90-aea4-4313-b1d6-01f2f7d02635 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:23.186552 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-6275b768-2a43-4897-87ba-7725d1794530 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c" status: 200 len: 1366 microversion: 2.1 time: 0.464831 Oct 17 03:54:23.193123 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-e4d67f90-aea4-4313-b1d6-01f2f7d02635 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1362 microversion: 2.1 time: 1.501145 Oct 17 03:54:23.194310 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 32/69] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:21 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1362 bytes in 1503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:23.197909 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 38/70] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:22 2022] GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c => generated 1366 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:23.228321 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-f09fe5a2-65da-4820-bbc1-d5b360521e01 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:23.228321 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-f09fe5a2-65da-4820-bbc1-d5b360521e01 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] [instance: b2c3871a-d117-4e6c-99c5-14777380ba38] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:23.231861 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=7 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:54:23.233570 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f09fe5a2-65da-4820-bbc1-d5b360521e01 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:23.234288 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f09fe5a2-65da-4820-bbc1-d5b360521e01 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:23.235125 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f09fe5a2-65da-4820-bbc1-d5b360521e01 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:23.236377 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f09fe5a2-65da-4820-bbc1-d5b360521e01 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:23.237029 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f09fe5a2-65da-4820-bbc1-d5b360521e01 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:23.237855 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f09fe5a2-65da-4820-bbc1-d5b360521e01 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:23.667601 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-c15b7c3c-3cbb-40bf-bca4-99da1c96d585 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:23.668457 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-c15b7c3c-3cbb-40bf-bca4-99da1c96d585 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 15a2e41f-4480-429c-9207-8d95daa186f5] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:23.680743 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c15b7c3c-3cbb-40bf-bca4-99da1c96d585 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:23.688276 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c15b7c3c-3cbb-40bf-bca4-99da1c96d585 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:23.690512 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c15b7c3c-3cbb-40bf-bca4-99da1c96d585 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:23.691299 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c15b7c3c-3cbb-40bf-bca4-99da1c96d585 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:23.697260 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c15b7c3c-3cbb-40bf-bca4-99da1c96d585 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:23.697928 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c15b7c3c-3cbb-40bf-bca4-99da1c96d585 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:23.764109 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-f09fe5a2-65da-4820-bbc1-d5b360521e01 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc1a698f79642088bb13b3b40d25dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4043f98c7544df8d2ad8152faf5299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:23.790177 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_cell1:SELECT=100 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:54:23.836691 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-f09fe5a2-65da-4820-bbc1-d5b360521e01 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] 10.222.0.16 "GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38" status: 200 len: 1315 microversion: 2.1 time: 0.637970 Oct 17 03:54:23.855941 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 33/71] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:23 2022] GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38 => generated 1315 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:24.106113 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [req-63d7a426-d516-48cd-819a-ba803622cffc req-0b1f9839-a2e2-4104-8d5a-70dcda2ef614 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf50abcd-84fd-4541-b899-b6f5dad606fe", "tag": "8be4dcfc-e0ee-4198-b87d-22c3d9c49993"}]} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:54:24.109785 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-c15b7c3c-3cbb-40bf-bca4-99da1c96d585 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:24.121227 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-c15b7c3c-3cbb-40bf-bca4-99da1c96d585 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5" status: 200 len: 1322 microversion: 2.1 time: 0.457438 Oct 17 03:54:24.121836 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 39/72] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:23 2022] GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5 => generated 1322 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:24.157824 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-63d7a426-d516-48cd-819a-ba803622cffc req-0b1f9839-a2e2-4104-8d5a-70dcda2ef614 service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:24.158532 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-63d7a426-d516-48cd-819a-ba803622cffc req-0b1f9839-a2e2-4104-8d5a-70dcda2ef614 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:24.159129 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-63d7a426-d516-48cd-819a-ba803622cffc req-0b1f9839-a2e2-4104-8d5a-70dcda2ef614 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:24.197250 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.compute.server_external_events [req-63d7a426-d516-48cd-819a-ba803622cffc req-0b1f9839-a2e2-4104-8d5a-70dcda2ef614 service nova] Creating event network-changed:8be4dcfc-e0ee-4198-b87d-22c3d9c49993 for instance bf50abcd-84fd-4541-b899-b6f5dad606fe on hv-cinder-81558 Oct 17 03:54:24.198535 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-63d7a426-d516-48cd-819a-ba803622cffc req-0b1f9839-a2e2-4104-8d5a-70dcda2ef614 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=125871) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 17 03:54:24.199123 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-63d7a426-d516-48cd-819a-ba803622cffc req-0b1f9839-a2e2-4104-8d5a-70dcda2ef614 service nova] Acquired lock "compute-rpcapi-router" {{(pid=125871) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 17 03:54:24.200400 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-db7e3f31-f63d-4c3c-a0b9-cba2868a28df None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:24.201036 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-db7e3f31-f63d-4c3c-a0b9-cba2868a28df None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:24.206169 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-db7e3f31-f63d-4c3c-a0b9-cba2868a28df None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:24.206169 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-db7e3f31-f63d-4c3c-a0b9-cba2868a28df None None] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:24.206169 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-db7e3f31-f63d-4c3c-a0b9-cba2868a28df None None] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:24.206169 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-db7e3f31-f63d-4c3c-a0b9-cba2868a28df None None] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:24.213223 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-44191acd-f1d2-45ff-b8d2-43be93297bbf tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:24.233105 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-44191acd-f1d2-45ff-b8d2-43be93297bbf tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: ff49fd54-9ddf-415d-8eb4-fb1b0bef634c] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:24.266748 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-44191acd-f1d2-45ff-b8d2-43be93297bbf tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:24.268737 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-44191acd-f1d2-45ff-b8d2-43be93297bbf tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:24.274586 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-44191acd-f1d2-45ff-b8d2-43be93297bbf tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:24.275757 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-44191acd-f1d2-45ff-b8d2-43be93297bbf tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:24.276436 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-44191acd-f1d2-45ff-b8d2-43be93297bbf tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:24.277128 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-44191acd-f1d2-45ff-b8d2-43be93297bbf tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:24.300333 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.compute.rpcapi [None req-db7e3f31-f63d-4c3c-a0b9-cba2868a28df None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 17 03:54:24.303215 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-db7e3f31-f63d-4c3c-a0b9-cba2868a28df None None] Releasing lock "compute-rpcapi-router" {{(pid=125871) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 17 03:54:24.344125 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-db7e3f31-f63d-4c3c-a0b9-cba2868a28df None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.246914 Oct 17 03:54:24.366740 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 34/73] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 03:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:54:24.382276 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-e1933eca-c20d-4961-a23e-ad87ea527d82 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:24.386526 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-e1933eca-c20d-4961-a23e-ad87ea527d82 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:24.398533 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e1933eca-c20d-4961-a23e-ad87ea527d82 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:24.399135 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e1933eca-c20d-4961-a23e-ad87ea527d82 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:24.400530 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e1933eca-c20d-4961-a23e-ad87ea527d82 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:24.400530 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e1933eca-c20d-4961-a23e-ad87ea527d82 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:24.400941 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e1933eca-c20d-4961-a23e-ad87ea527d82 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:24.417388 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e1933eca-c20d-4961-a23e-ad87ea527d82 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:24.583778 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-44191acd-f1d2-45ff-b8d2-43be93297bbf tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:24.601755 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-44191acd-f1d2-45ff-b8d2-43be93297bbf tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c" status: 200 len: 1366 microversion: 2.1 time: 0.388607 Oct 17 03:54:24.601755 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 40/74] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:24 2022] GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c => generated 1366 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:24.815642 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-e1933eca-c20d-4961-a23e-ad87ea527d82 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:24.857553 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-e1933eca-c20d-4961-a23e-ad87ea527d82 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1362 microversion: 2.1 time: 0.468357 Oct 17 03:54:24.860456 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 35/75] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:24 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1362 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:24.873539 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-e9361e1a-ac4a-41b5-b131-202a22cef777 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:24.877339 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-e9361e1a-ac4a-41b5-b131-202a22cef777 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] [instance: b2c3871a-d117-4e6c-99c5-14777380ba38] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:24.889434 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e9361e1a-ac4a-41b5-b131-202a22cef777 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:24.890667 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e9361e1a-ac4a-41b5-b131-202a22cef777 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:24.893910 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e9361e1a-ac4a-41b5-b131-202a22cef777 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:24.894728 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e9361e1a-ac4a-41b5-b131-202a22cef777 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:24.895232 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e9361e1a-ac4a-41b5-b131-202a22cef777 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:24.895676 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e9361e1a-ac4a-41b5-b131-202a22cef777 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:25.147793 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-96c92f84-966b-4806-a524-ae2fe938c5d2 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:25.148851 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-96c92f84-966b-4806-a524-ae2fe938c5d2 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 15a2e41f-4480-429c-9207-8d95daa186f5] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:25.190234 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-96c92f84-966b-4806-a524-ae2fe938c5d2 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:25.191307 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-96c92f84-966b-4806-a524-ae2fe938c5d2 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:25.192011 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-96c92f84-966b-4806-a524-ae2fe938c5d2 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:25.195071 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-96c92f84-966b-4806-a524-ae2fe938c5d2 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:25.196323 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-96c92f84-966b-4806-a524-ae2fe938c5d2 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:25.197456 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-96c92f84-966b-4806-a524-ae2fe938c5d2 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:25.267387 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-e9361e1a-ac4a-41b5-b131-202a22cef777 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc1a698f79642088bb13b3b40d25dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4043f98c7544df8d2ad8152faf5299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:25.286823 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-e9361e1a-ac4a-41b5-b131-202a22cef777 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] 10.222.0.16 "GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38" status: 200 len: 1315 microversion: 2.1 time: 0.420672 Oct 17 03:54:25.300000 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 41/76] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:24 2022] GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38 => generated 1315 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:25.579268 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-96c92f84-966b-4806-a524-ae2fe938c5d2 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:25.589768 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-96c92f84-966b-4806-a524-ae2fe938c5d2 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5" status: 200 len: 1322 microversion: 2.1 time: 0.446568 Oct 17 03:54:25.590836 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 36/77] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:25 2022] GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5 => generated 1322 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:25.623055 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-a29e0709-c5ce-4d3c-81ff-a082248d7829 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:25.624806 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-a29e0709-c5ce-4d3c-81ff-a082248d7829 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: ff49fd54-9ddf-415d-8eb4-fb1b0bef634c] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:25.632446 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a29e0709-c5ce-4d3c-81ff-a082248d7829 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:25.633859 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a29e0709-c5ce-4d3c-81ff-a082248d7829 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:25.636435 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a29e0709-c5ce-4d3c-81ff-a082248d7829 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:25.636435 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a29e0709-c5ce-4d3c-81ff-a082248d7829 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:25.636435 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a29e0709-c5ce-4d3c-81ff-a082248d7829 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:25.637008 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a29e0709-c5ce-4d3c-81ff-a082248d7829 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:25.835096 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-a29e0709-c5ce-4d3c-81ff-a082248d7829 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:25.852444 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-a29e0709-c5ce-4d3c-81ff-a082248d7829 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c" status: 200 len: 1366 microversion: 2.1 time: 0.233895 Oct 17 03:54:25.853340 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 42/78] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:25 2022] GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c => generated 1366 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:25.882268 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-6b6db921-43ff-412e-b145-4cb2a5ff986e tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:25.883477 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-6b6db921-43ff-412e-b145-4cb2a5ff986e tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:25.898208 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-6b6db921-43ff-412e-b145-4cb2a5ff986e tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:25.899854 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-6b6db921-43ff-412e-b145-4cb2a5ff986e tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:25.900792 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-6b6db921-43ff-412e-b145-4cb2a5ff986e tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:25.902190 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-6b6db921-43ff-412e-b145-4cb2a5ff986e tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:25.904837 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-6b6db921-43ff-412e-b145-4cb2a5ff986e tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:25.907952 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-6b6db921-43ff-412e-b145-4cb2a5ff986e tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:26.261289 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-6b6db921-43ff-412e-b145-4cb2a5ff986e tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:26.271095 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-6b6db921-43ff-412e-b145-4cb2a5ff986e tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1362 microversion: 2.1 time: 0.391450 Oct 17 03:54:26.283680 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 37/79] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:25 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1362 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:26.318367 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-f11c4b4b-9b60-47cb-bd82-f82bbed2f26f tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:26.319331 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-f11c4b4b-9b60-47cb-bd82-f82bbed2f26f tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] [instance: b2c3871a-d117-4e6c-99c5-14777380ba38] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:26.332494 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f11c4b4b-9b60-47cb-bd82-f82bbed2f26f tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:26.333104 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f11c4b4b-9b60-47cb-bd82-f82bbed2f26f tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:26.333801 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f11c4b4b-9b60-47cb-bd82-f82bbed2f26f tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:26.340250 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f11c4b4b-9b60-47cb-bd82-f82bbed2f26f tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:26.340709 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f11c4b4b-9b60-47cb-bd82-f82bbed2f26f tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:26.341237 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f11c4b4b-9b60-47cb-bd82-f82bbed2f26f tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:26.601307 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [req-cee0597a-1e45-4468-a7ba-10ead00bff26 req-5b0a5f17-5ad0-4aee-97c9-b09220418784 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15a2e41f-4480-429c-9207-8d95daa186f5", "tag": "d40b4ca9-61e5-4ad3-89cf-f8e01e08a864"}]} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:54:26.623363 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-cee0597a-1e45-4468-a7ba-10ead00bff26 req-5b0a5f17-5ad0-4aee-97c9-b09220418784 service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:26.623915 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-cee0597a-1e45-4468-a7ba-10ead00bff26 req-5b0a5f17-5ad0-4aee-97c9-b09220418784 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:26.624305 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-cee0597a-1e45-4468-a7ba-10ead00bff26 req-5b0a5f17-5ad0-4aee-97c9-b09220418784 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:26.705091 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-f11c4b4b-9b60-47cb-bd82-f82bbed2f26f tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc1a698f79642088bb13b3b40d25dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4043f98c7544df8d2ad8152faf5299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:26.706549 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.compute.server_external_events [req-cee0597a-1e45-4468-a7ba-10ead00bff26 req-5b0a5f17-5ad0-4aee-97c9-b09220418784 service nova] Creating event network-changed:d40b4ca9-61e5-4ad3-89cf-f8e01e08a864 for instance 15a2e41f-4480-429c-9207-8d95daa186f5 on hv-cinder-81558 Oct 17 03:54:26.706653 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-f11c4b4b-9b60-47cb-bd82-f82bbed2f26f tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] 10.222.0.16 "GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38" status: 200 len: 1315 microversion: 2.1 time: 0.361869 Oct 17 03:54:26.706653 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 43/80] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:26 2022] GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38 => generated 1315 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:26.706786 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [req-cee0597a-1e45-4468-a7ba-10ead00bff26 req-5b0a5f17-5ad0-4aee-97c9-b09220418784 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079694 Oct 17 03:54:26.706786 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 38/81] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 03:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 03:54:26.706913 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-bd41d89c-e3ad-4e1d-8136-168fcc6d4db9 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:26.706913 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-bd41d89c-e3ad-4e1d-8136-168fcc6d4db9 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 15a2e41f-4480-429c-9207-8d95daa186f5] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:26.706913 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-bd41d89c-e3ad-4e1d-8136-168fcc6d4db9 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:26.706913 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-bd41d89c-e3ad-4e1d-8136-168fcc6d4db9 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:26.707917 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-bd41d89c-e3ad-4e1d-8136-168fcc6d4db9 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:26.707917 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-bd41d89c-e3ad-4e1d-8136-168fcc6d4db9 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:26.707917 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-bd41d89c-e3ad-4e1d-8136-168fcc6d4db9 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:26.707917 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-bd41d89c-e3ad-4e1d-8136-168fcc6d4db9 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:26.884873 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-96b19ae2-07cd-4abf-82d3-e4de918e741c tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:26.900284 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-96b19ae2-07cd-4abf-82d3-e4de918e741c tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: ff49fd54-9ddf-415d-8eb4-fb1b0bef634c] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:26.900284 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-96b19ae2-07cd-4abf-82d3-e4de918e741c tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:26.900284 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-96b19ae2-07cd-4abf-82d3-e4de918e741c tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:26.902642 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-96b19ae2-07cd-4abf-82d3-e4de918e741c tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:26.903925 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-96b19ae2-07cd-4abf-82d3-e4de918e741c tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:26.904476 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-96b19ae2-07cd-4abf-82d3-e4de918e741c tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:26.905135 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-96b19ae2-07cd-4abf-82d3-e4de918e741c tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:27.005810 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-bd41d89c-e3ad-4e1d-8136-168fcc6d4db9 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:27.021341 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-bd41d89c-e3ad-4e1d-8136-168fcc6d4db9 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5" status: 200 len: 1322 microversion: 2.1 time: 0.344418 Oct 17 03:54:27.044012 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 44/82] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:26 2022] GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5 => generated 1322 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:27.242604 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-96b19ae2-07cd-4abf-82d3-e4de918e741c tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:27.250778 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-96b19ae2-07cd-4abf-82d3-e4de918e741c tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c" status: 200 len: 1366 microversion: 2.1 time: 0.372543 Oct 17 03:54:27.251372 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 39/83] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:26 2022] GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c => generated 1366 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:54:27.295740 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-e5013858-4238-4220-81f1-ee104b6314c9 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:27.296943 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-e5013858-4238-4220-81f1-ee104b6314c9 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:27.303372 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e5013858-4238-4220-81f1-ee104b6314c9 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:27.303867 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e5013858-4238-4220-81f1-ee104b6314c9 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:27.304305 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e5013858-4238-4220-81f1-ee104b6314c9 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:27.305016 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e5013858-4238-4220-81f1-ee104b6314c9 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:27.305484 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e5013858-4238-4220-81f1-ee104b6314c9 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:27.305910 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e5013858-4238-4220-81f1-ee104b6314c9 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:27.450593 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-e5013858-4238-4220-81f1-ee104b6314c9 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:27.458597 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-e5013858-4238-4220-81f1-ee104b6314c9 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1362 microversion: 2.1 time: 0.166869 Oct 17 03:54:27.459200 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 45/84] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:27 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:27.730095 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-1c0b6ac4-ff4d-4bdf-8fff-50e4358b435b tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:27.730651 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-1c0b6ac4-ff4d-4bdf-8fff-50e4358b435b tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] [instance: b2c3871a-d117-4e6c-99c5-14777380ba38] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:27.736546 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1c0b6ac4-ff4d-4bdf-8fff-50e4358b435b tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:27.737017 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1c0b6ac4-ff4d-4bdf-8fff-50e4358b435b tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:27.737447 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1c0b6ac4-ff4d-4bdf-8fff-50e4358b435b tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:27.738122 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1c0b6ac4-ff4d-4bdf-8fff-50e4358b435b tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:27.738572 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1c0b6ac4-ff4d-4bdf-8fff-50e4358b435b tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:27.738984 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1c0b6ac4-ff4d-4bdf-8fff-50e4358b435b tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:27.875842 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-1c0b6ac4-ff4d-4bdf-8fff-50e4358b435b tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc1a698f79642088bb13b3b40d25dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4043f98c7544df8d2ad8152faf5299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:27.883312 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-1c0b6ac4-ff4d-4bdf-8fff-50e4358b435b tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] 10.222.0.16 "GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38" status: 200 len: 1315 microversion: 2.1 time: 0.157089 Oct 17 03:54:27.883881 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 40/85] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:27 2022] GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:28.055151 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-f69fe74a-6603-4c0e-a5a6-3b0f2f62d7be tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:28.055718 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-f69fe74a-6603-4c0e-a5a6-3b0f2f62d7be tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 15a2e41f-4480-429c-9207-8d95daa186f5] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:28.062209 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f69fe74a-6603-4c0e-a5a6-3b0f2f62d7be tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:28.062690 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f69fe74a-6603-4c0e-a5a6-3b0f2f62d7be tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:28.063127 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f69fe74a-6603-4c0e-a5a6-3b0f2f62d7be tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:28.063837 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f69fe74a-6603-4c0e-a5a6-3b0f2f62d7be tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:28.064289 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f69fe74a-6603-4c0e-a5a6-3b0f2f62d7be tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:28.064711 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f69fe74a-6603-4c0e-a5a6-3b0f2f62d7be tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:28.188244 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-f69fe74a-6603-4c0e-a5a6-3b0f2f62d7be tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:28.195810 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-f69fe74a-6603-4c0e-a5a6-3b0f2f62d7be tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5" status: 200 len: 1322 microversion: 2.1 time: 0.144621 Oct 17 03:54:28.196387 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 46/86] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:28 2022] GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5 => generated 1322 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:28.331977 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-2db5e013-49d9-42f4-8c64-ff5e2c857ef3 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:28.332615 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-2db5e013-49d9-42f4-8c64-ff5e2c857ef3 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: ff49fd54-9ddf-415d-8eb4-fb1b0bef634c] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:28.339094 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2db5e013-49d9-42f4-8c64-ff5e2c857ef3 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:28.340134 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2db5e013-49d9-42f4-8c64-ff5e2c857ef3 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:28.340575 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2db5e013-49d9-42f4-8c64-ff5e2c857ef3 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:28.341281 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2db5e013-49d9-42f4-8c64-ff5e2c857ef3 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:28.341794 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2db5e013-49d9-42f4-8c64-ff5e2c857ef3 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:28.342215 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2db5e013-49d9-42f4-8c64-ff5e2c857ef3 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:28.481770 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-bb46ef86-8d4c-4513-9e08-ccd5f4baceca tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:28.482635 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-bb46ef86-8d4c-4513-9e08-ccd5f4baceca tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:28.491110 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-bb46ef86-8d4c-4513-9e08-ccd5f4baceca tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:28.491110 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-bb46ef86-8d4c-4513-9e08-ccd5f4baceca tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:28.491110 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-bb46ef86-8d4c-4513-9e08-ccd5f4baceca tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:28.491500 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-2db5e013-49d9-42f4-8c64-ff5e2c857ef3 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:28.491593 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-bb46ef86-8d4c-4513-9e08-ccd5f4baceca tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:28.492188 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-bb46ef86-8d4c-4513-9e08-ccd5f4baceca tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:28.492808 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-bb46ef86-8d4c-4513-9e08-ccd5f4baceca tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:28.501146 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-2db5e013-49d9-42f4-8c64-ff5e2c857ef3 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c" status: 200 len: 1366 microversion: 2.1 time: 0.175749 Oct 17 03:54:28.502022 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 41/87] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:28 2022] GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:28.633711 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-bb46ef86-8d4c-4513-9e08-ccd5f4baceca tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:28.641703 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-bb46ef86-8d4c-4513-9e08-ccd5f4baceca tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1362 microversion: 2.1 time: 0.163959 Oct 17 03:54:28.642270 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 47/88] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:28 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:54:28.908453 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-2e47bfc3-4729-4d59-b519-77fc08884469 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:28.909064 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-2e47bfc3-4729-4d59-b519-77fc08884469 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] [instance: b2c3871a-d117-4e6c-99c5-14777380ba38] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:28.915104 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2e47bfc3-4729-4d59-b519-77fc08884469 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:28.915617 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2e47bfc3-4729-4d59-b519-77fc08884469 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:28.916048 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2e47bfc3-4729-4d59-b519-77fc08884469 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:28.916735 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2e47bfc3-4729-4d59-b519-77fc08884469 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:28.917176 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2e47bfc3-4729-4d59-b519-77fc08884469 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:28.917591 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2e47bfc3-4729-4d59-b519-77fc08884469 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:29.074527 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-2e47bfc3-4729-4d59-b519-77fc08884469 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc1a698f79642088bb13b3b40d25dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4043f98c7544df8d2ad8152faf5299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:29.083113 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-2e47bfc3-4729-4d59-b519-77fc08884469 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] 10.222.0.16 "GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38" status: 200 len: 1315 microversion: 2.1 time: 0.179362 Oct 17 03:54:29.083664 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 42/89] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:28 2022] GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:29.219956 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-688c1a37-2fc3-4178-8357-e2a2bde52f50 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:29.220592 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-688c1a37-2fc3-4178-8357-e2a2bde52f50 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 15a2e41f-4480-429c-9207-8d95daa186f5] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:29.226506 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-688c1a37-2fc3-4178-8357-e2a2bde52f50 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:29.227851 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-688c1a37-2fc3-4178-8357-e2a2bde52f50 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:29.227851 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-688c1a37-2fc3-4178-8357-e2a2bde52f50 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:29.228121 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-688c1a37-2fc3-4178-8357-e2a2bde52f50 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:29.228578 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-688c1a37-2fc3-4178-8357-e2a2bde52f50 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:29.228999 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-688c1a37-2fc3-4178-8357-e2a2bde52f50 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:29.370176 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-688c1a37-2fc3-4178-8357-e2a2bde52f50 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:29.378587 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-688c1a37-2fc3-4178-8357-e2a2bde52f50 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5" status: 200 len: 1322 microversion: 2.1 time: 0.163213 Oct 17 03:54:29.379151 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 48/90] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:29 2022] GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:29.524385 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-866c5936-fc4c-4ce7-b73c-5b6ce5e5718e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:29.525004 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-866c5936-fc4c-4ce7-b73c-5b6ce5e5718e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: ff49fd54-9ddf-415d-8eb4-fb1b0bef634c] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:29.531589 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-866c5936-fc4c-4ce7-b73c-5b6ce5e5718e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:29.534351 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-866c5936-fc4c-4ce7-b73c-5b6ce5e5718e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:29.534351 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-866c5936-fc4c-4ce7-b73c-5b6ce5e5718e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:29.534351 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-866c5936-fc4c-4ce7-b73c-5b6ce5e5718e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:29.534351 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-866c5936-fc4c-4ce7-b73c-5b6ce5e5718e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:29.534736 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-866c5936-fc4c-4ce7-b73c-5b6ce5e5718e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:29.664592 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-bb9145a6-c753-4889-b7b4-0740808162c6 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:29.665301 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-bb9145a6-c753-4889-b7b4-0740808162c6 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:29.669173 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-866c5936-fc4c-4ce7-b73c-5b6ce5e5718e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:29.674083 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-bb9145a6-c753-4889-b7b4-0740808162c6 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:29.674083 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-bb9145a6-c753-4889-b7b4-0740808162c6 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:29.674083 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-bb9145a6-c753-4889-b7b4-0740808162c6 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:29.674083 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-bb9145a6-c753-4889-b7b4-0740808162c6 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:29.674438 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-bb9145a6-c753-4889-b7b4-0740808162c6 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:29.674816 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-bb9145a6-c753-4889-b7b4-0740808162c6 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:29.677327 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-866c5936-fc4c-4ce7-b73c-5b6ce5e5718e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c" status: 200 len: 1366 microversion: 2.1 time: 0.156763 Oct 17 03:54:29.677897 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 43/91] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:29 2022] GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:29.819329 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-bb9145a6-c753-4889-b7b4-0740808162c6 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:29.820850 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-bb9145a6-c753-4889-b7b4-0740808162c6 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1362 microversion: 2.1 time: 0.159959 Oct 17 03:54:29.821548 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 49/92] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:29 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:54:30.109076 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-2e3bc589-1b47-4281-954e-8ed2f7b59bbc tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:30.109076 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-2e3bc589-1b47-4281-954e-8ed2f7b59bbc tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] [instance: b2c3871a-d117-4e6c-99c5-14777380ba38] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:30.114426 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2e3bc589-1b47-4281-954e-8ed2f7b59bbc tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:30.114964 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2e3bc589-1b47-4281-954e-8ed2f7b59bbc tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:30.115495 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2e3bc589-1b47-4281-954e-8ed2f7b59bbc tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:30.116141 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2e3bc589-1b47-4281-954e-8ed2f7b59bbc tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:30.116601 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2e3bc589-1b47-4281-954e-8ed2f7b59bbc tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:30.117027 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2e3bc589-1b47-4281-954e-8ed2f7b59bbc tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:30.261874 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-2e3bc589-1b47-4281-954e-8ed2f7b59bbc tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc1a698f79642088bb13b3b40d25dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4043f98c7544df8d2ad8152faf5299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:30.270589 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-2e3bc589-1b47-4281-954e-8ed2f7b59bbc tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] 10.222.0.16 "GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38" status: 200 len: 1315 microversion: 2.1 time: 0.167745 Oct 17 03:54:30.271375 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 44/93] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:30 2022] GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:30.405145 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-1875e6ab-8a66-42b6-b4e0-8761d1258b64 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:30.405679 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-1875e6ab-8a66-42b6-b4e0-8761d1258b64 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 15a2e41f-4480-429c-9207-8d95daa186f5] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:30.407607 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_cell0:SELECT=2 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:54:30.412359 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1875e6ab-8a66-42b6-b4e0-8761d1258b64 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:30.412833 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1875e6ab-8a66-42b6-b4e0-8761d1258b64 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:30.413261 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1875e6ab-8a66-42b6-b4e0-8761d1258b64 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:30.413940 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1875e6ab-8a66-42b6-b4e0-8761d1258b64 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:30.414387 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1875e6ab-8a66-42b6-b4e0-8761d1258b64 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:30.414810 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1875e6ab-8a66-42b6-b4e0-8761d1258b64 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:30.563368 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-1875e6ab-8a66-42b6-b4e0-8761d1258b64 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:30.571125 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-1875e6ab-8a66-42b6-b4e0-8761d1258b64 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5" status: 200 len: 1322 microversion: 2.1 time: 0.169915 Oct 17 03:54:30.571863 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 50/94] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:30 2022] GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5 => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:30.699934 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-5fc931c8-e1f8-4eed-9cbb-52163c57c990 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:30.700812 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-5fc931c8-e1f8-4eed-9cbb-52163c57c990 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: ff49fd54-9ddf-415d-8eb4-fb1b0bef634c] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:30.707005 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5fc931c8-e1f8-4eed-9cbb-52163c57c990 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:30.707602 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5fc931c8-e1f8-4eed-9cbb-52163c57c990 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:30.708043 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5fc931c8-e1f8-4eed-9cbb-52163c57c990 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:30.708795 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5fc931c8-e1f8-4eed-9cbb-52163c57c990 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:30.709253 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5fc931c8-e1f8-4eed-9cbb-52163c57c990 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:30.709679 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5fc931c8-e1f8-4eed-9cbb-52163c57c990 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:30.843583 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-04f9463f-221a-466b-8c4a-c56fd430f8ad tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:30.844199 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-04f9463f-221a-466b-8c4a-c56fd430f8ad tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:30.850201 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-04f9463f-221a-466b-8c4a-c56fd430f8ad tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:30.850893 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-04f9463f-221a-466b-8c4a-c56fd430f8ad tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:30.856945 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-04f9463f-221a-466b-8c4a-c56fd430f8ad tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:30.856945 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-04f9463f-221a-466b-8c4a-c56fd430f8ad tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:30.856945 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-04f9463f-221a-466b-8c4a-c56fd430f8ad tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:30.856945 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-04f9463f-221a-466b-8c4a-c56fd430f8ad tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:30.857691 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-5fc931c8-e1f8-4eed-9cbb-52163c57c990 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:30.868021 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-5fc931c8-e1f8-4eed-9cbb-52163c57c990 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c" status: 200 len: 1366 microversion: 2.1 time: 0.171839 Oct 17 03:54:30.868992 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 45/95] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:30 2022] GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:30.987442 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-04f9463f-221a-466b-8c4a-c56fd430f8ad tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:30.996140 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-04f9463f-221a-466b-8c4a-c56fd430f8ad tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1362 microversion: 2.1 time: 0.156223 Oct 17 03:54:30.996803 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 51/96] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:30 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:31.300552 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-2bcc465c-3cfe-43f4-b6ba-680295611474 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:31.300552 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-2bcc465c-3cfe-43f4-b6ba-680295611474 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] [instance: b2c3871a-d117-4e6c-99c5-14777380ba38] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:31.308743 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2bcc465c-3cfe-43f4-b6ba-680295611474 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:31.309434 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2bcc465c-3cfe-43f4-b6ba-680295611474 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:31.309869 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2bcc465c-3cfe-43f4-b6ba-680295611474 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:31.310567 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2bcc465c-3cfe-43f4-b6ba-680295611474 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:31.311019 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2bcc465c-3cfe-43f4-b6ba-680295611474 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:31.311467 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2bcc465c-3cfe-43f4-b6ba-680295611474 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:31.444504 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-2bcc465c-3cfe-43f4-b6ba-680295611474 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc1a698f79642088bb13b3b40d25dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4043f98c7544df8d2ad8152faf5299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:31.452889 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-2bcc465c-3cfe-43f4-b6ba-680295611474 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] 10.222.0.16 "GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38" status: 200 len: 1315 microversion: 2.1 time: 0.162676 Oct 17 03:54:31.453457 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 46/97] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:31 2022] GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:31.594396 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-e9440769-9d54-48a7-9438-f2dc5a709260 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:31.595210 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-e9440769-9d54-48a7-9438-f2dc5a709260 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 15a2e41f-4480-429c-9207-8d95daa186f5] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:31.601544 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e9440769-9d54-48a7-9438-f2dc5a709260 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:31.602032 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e9440769-9d54-48a7-9438-f2dc5a709260 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:31.602486 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e9440769-9d54-48a7-9438-f2dc5a709260 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:31.603161 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e9440769-9d54-48a7-9438-f2dc5a709260 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:31.603638 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e9440769-9d54-48a7-9438-f2dc5a709260 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:31.604063 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e9440769-9d54-48a7-9438-f2dc5a709260 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:31.735228 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-e9440769-9d54-48a7-9438-f2dc5a709260 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:31.738872 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_cell1:SELECT=100 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:54:31.743569 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-e9440769-9d54-48a7-9438-f2dc5a709260 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5" status: 200 len: 1322 microversion: 2.1 time: 0.153622 Oct 17 03:54:31.744238 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 52/98] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:31 2022] GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:31.893297 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-5ce9bb01-220d-4326-96da-f8e7a8d11116 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:31.894001 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-5ce9bb01-220d-4326-96da-f8e7a8d11116 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: ff49fd54-9ddf-415d-8eb4-fb1b0bef634c] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:31.899989 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5ce9bb01-220d-4326-96da-f8e7a8d11116 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:31.900540 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5ce9bb01-220d-4326-96da-f8e7a8d11116 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:31.900956 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5ce9bb01-220d-4326-96da-f8e7a8d11116 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:31.901638 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5ce9bb01-220d-4326-96da-f8e7a8d11116 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:31.902156 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5ce9bb01-220d-4326-96da-f8e7a8d11116 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:31.902502 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5ce9bb01-220d-4326-96da-f8e7a8d11116 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:32.021087 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-1059ee54-142b-49af-8a0f-2920674030f3 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:32.021699 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-1059ee54-142b-49af-8a0f-2920674030f3 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:32.028306 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1059ee54-142b-49af-8a0f-2920674030f3 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:32.028789 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1059ee54-142b-49af-8a0f-2920674030f3 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:32.029411 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1059ee54-142b-49af-8a0f-2920674030f3 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:32.030209 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1059ee54-142b-49af-8a0f-2920674030f3 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:32.030667 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1059ee54-142b-49af-8a0f-2920674030f3 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:32.031091 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1059ee54-142b-49af-8a0f-2920674030f3 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:32.055982 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-5ce9bb01-220d-4326-96da-f8e7a8d11116 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:32.064967 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-5ce9bb01-220d-4326-96da-f8e7a8d11116 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c" status: 200 len: 1366 microversion: 2.1 time: 0.176372 Oct 17 03:54:32.065637 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 47/99] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:31 2022] GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:32.163314 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-1059ee54-142b-49af-8a0f-2920674030f3 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:32.172088 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-1059ee54-142b-49af-8a0f-2920674030f3 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1362 microversion: 2.1 time: 0.155936 Oct 17 03:54:32.172652 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 53/100] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:32 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:54:32.475871 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-effa599f-c16f-4314-85b5-2df939b4290c tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:32.476953 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-effa599f-c16f-4314-85b5-2df939b4290c tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] [instance: b2c3871a-d117-4e6c-99c5-14777380ba38] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:32.483823 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-effa599f-c16f-4314-85b5-2df939b4290c tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:32.484576 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-effa599f-c16f-4314-85b5-2df939b4290c tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:32.485214 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-effa599f-c16f-4314-85b5-2df939b4290c tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:32.486003 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-effa599f-c16f-4314-85b5-2df939b4290c tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:32.486681 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-effa599f-c16f-4314-85b5-2df939b4290c tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:32.487361 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-effa599f-c16f-4314-85b5-2df939b4290c tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:32.647927 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-effa599f-c16f-4314-85b5-2df939b4290c tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc1a698f79642088bb13b3b40d25dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4043f98c7544df8d2ad8152faf5299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:32.656095 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-effa599f-c16f-4314-85b5-2df939b4290c tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] 10.222.0.16 "GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38" status: 200 len: 1315 microversion: 2.1 time: 0.184150 Oct 17 03:54:32.656677 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 48/101] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:32 2022] GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38 => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:32.766913 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-8827ec2d-057c-4aa4-a397-740fcd6566a3 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:32.767561 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-8827ec2d-057c-4aa4-a397-740fcd6566a3 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 15a2e41f-4480-429c-9207-8d95daa186f5] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:32.776299 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8827ec2d-057c-4aa4-a397-740fcd6566a3 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:32.776299 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8827ec2d-057c-4aa4-a397-740fcd6566a3 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:32.776299 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8827ec2d-057c-4aa4-a397-740fcd6566a3 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:32.776299 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8827ec2d-057c-4aa4-a397-740fcd6566a3 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:32.776612 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8827ec2d-057c-4aa4-a397-740fcd6566a3 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:32.776612 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8827ec2d-057c-4aa4-a397-740fcd6566a3 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:32.930562 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-8827ec2d-057c-4aa4-a397-740fcd6566a3 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:32.941497 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-8827ec2d-057c-4aa4-a397-740fcd6566a3 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5" status: 200 len: 1322 microversion: 2.1 time: 0.178817 Oct 17 03:54:32.942280 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 54/102] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:32 2022] GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5 => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:33.088893 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-2a07bfa0-2305-4d06-88e7-36a2939d429e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:33.089718 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-2a07bfa0-2305-4d06-88e7-36a2939d429e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: ff49fd54-9ddf-415d-8eb4-fb1b0bef634c] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:33.099413 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2a07bfa0-2305-4d06-88e7-36a2939d429e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:33.100235 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2a07bfa0-2305-4d06-88e7-36a2939d429e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:33.100960 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2a07bfa0-2305-4d06-88e7-36a2939d429e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:33.102641 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2a07bfa0-2305-4d06-88e7-36a2939d429e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:33.103450 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2a07bfa0-2305-4d06-88e7-36a2939d429e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:33.104299 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2a07bfa0-2305-4d06-88e7-36a2939d429e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:33.199200 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-411d5e73-f7a5-4905-8fda-985855599980 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:33.202451 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-411d5e73-f7a5-4905-8fda-985855599980 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:33.207482 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-411d5e73-f7a5-4905-8fda-985855599980 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:33.208105 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-411d5e73-f7a5-4905-8fda-985855599980 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:33.208895 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-411d5e73-f7a5-4905-8fda-985855599980 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:33.209854 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-411d5e73-f7a5-4905-8fda-985855599980 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:33.210516 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-411d5e73-f7a5-4905-8fda-985855599980 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:33.211045 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-411d5e73-f7a5-4905-8fda-985855599980 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:33.271374 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-2a07bfa0-2305-4d06-88e7-36a2939d429e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:33.283237 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-2a07bfa0-2305-4d06-88e7-36a2939d429e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c" status: 200 len: 1366 microversion: 2.1 time: 0.198532 Oct 17 03:54:33.284431 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 49/103] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:33 2022] GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:33.410611 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-411d5e73-f7a5-4905-8fda-985855599980 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:33.417693 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-411d5e73-f7a5-4905-8fda-985855599980 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1362 microversion: 2.1 time: 0.226343 Oct 17 03:54:33.418282 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 55/104] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:33 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1362 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:33.679655 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-361d0bf7-a639-453d-8e98-1030ea2f8395 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:33.680608 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-361d0bf7-a639-453d-8e98-1030ea2f8395 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] [instance: b2c3871a-d117-4e6c-99c5-14777380ba38] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:33.687236 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-361d0bf7-a639-453d-8e98-1030ea2f8395 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:33.688079 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-361d0bf7-a639-453d-8e98-1030ea2f8395 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:33.688513 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-361d0bf7-a639-453d-8e98-1030ea2f8395 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:33.689201 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-361d0bf7-a639-453d-8e98-1030ea2f8395 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:33.689650 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-361d0bf7-a639-453d-8e98-1030ea2f8395 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:33.690068 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-361d0bf7-a639-453d-8e98-1030ea2f8395 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:33.860897 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-361d0bf7-a639-453d-8e98-1030ea2f8395 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc1a698f79642088bb13b3b40d25dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4043f98c7544df8d2ad8152faf5299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:33.873535 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-361d0bf7-a639-453d-8e98-1030ea2f8395 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] 10.222.0.16 "GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38" status: 200 len: 1315 microversion: 2.1 time: 0.197999 Oct 17 03:54:33.875270 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 50/105] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:33 2022] GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38 => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:33.969202 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-3b1c97fd-a263-46c5-948f-7ddfe2f8c997 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:33.969846 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-3b1c97fd-a263-46c5-948f-7ddfe2f8c997 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 15a2e41f-4480-429c-9207-8d95daa186f5] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:33.975962 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-3b1c97fd-a263-46c5-948f-7ddfe2f8c997 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:33.976517 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-3b1c97fd-a263-46c5-948f-7ddfe2f8c997 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:33.977209 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-3b1c97fd-a263-46c5-948f-7ddfe2f8c997 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:33.978283 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-3b1c97fd-a263-46c5-948f-7ddfe2f8c997 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:33.978927 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-3b1c97fd-a263-46c5-948f-7ddfe2f8c997 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:33.979679 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-3b1c97fd-a263-46c5-948f-7ddfe2f8c997 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:34.215154 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-3b1c97fd-a263-46c5-948f-7ddfe2f8c997 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:34.223278 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-3b1c97fd-a263-46c5-948f-7ddfe2f8c997 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5" status: 200 len: 1322 microversion: 2.1 time: 0.258650 Oct 17 03:54:34.224058 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 56/106] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:33 2022] GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5 => generated 1322 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:34.307242 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-16211561-8c31-43df-8d57-b7bf281c11e0 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:34.308392 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-16211561-8c31-43df-8d57-b7bf281c11e0 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: ff49fd54-9ddf-415d-8eb4-fb1b0bef634c] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:34.316408 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_cell0:SELECT=2 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:54:34.321107 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-16211561-8c31-43df-8d57-b7bf281c11e0 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:34.324103 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-16211561-8c31-43df-8d57-b7bf281c11e0 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:34.324758 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-16211561-8c31-43df-8d57-b7bf281c11e0 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:34.325816 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-16211561-8c31-43df-8d57-b7bf281c11e0 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:34.328659 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-16211561-8c31-43df-8d57-b7bf281c11e0 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:34.332043 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-16211561-8c31-43df-8d57-b7bf281c11e0 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:34.396996 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_cell1:SELECT=100 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:54:34.441393 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-dbc4ec58-d241-4af8-b44b-8e5d8aa784c1 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:34.442065 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-dbc4ec58-d241-4af8-b44b-8e5d8aa784c1 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:34.451699 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-dbc4ec58-d241-4af8-b44b-8e5d8aa784c1 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:34.452734 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-dbc4ec58-d241-4af8-b44b-8e5d8aa784c1 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:34.453144 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-dbc4ec58-d241-4af8-b44b-8e5d8aa784c1 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:34.453850 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-dbc4ec58-d241-4af8-b44b-8e5d8aa784c1 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:34.454448 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-dbc4ec58-d241-4af8-b44b-8e5d8aa784c1 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:34.455005 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-dbc4ec58-d241-4af8-b44b-8e5d8aa784c1 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:34.589893 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-16211561-8c31-43df-8d57-b7bf281c11e0 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:34.603305 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-16211561-8c31-43df-8d57-b7bf281c11e0 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c" status: 200 len: 1366 microversion: 2.1 time: 0.301251 Oct 17 03:54:34.609622 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-dbc4ec58-d241-4af8-b44b-8e5d8aa784c1 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:34.620273 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 51/107] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:34 2022] GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c => generated 1366 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:34.627352 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-dbc4ec58-d241-4af8-b44b-8e5d8aa784c1 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1362 microversion: 2.1 time: 0.190387 Oct 17 03:54:34.628903 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 57/108] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:34 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1362 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:54:34.898758 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-a1a1b6db-709f-4f43-99e8-92b55de0dd3d tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:34.900110 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-a1a1b6db-709f-4f43-99e8-92b55de0dd3d tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] [instance: b2c3871a-d117-4e6c-99c5-14777380ba38] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:34.907480 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a1a1b6db-709f-4f43-99e8-92b55de0dd3d tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:34.908108 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a1a1b6db-709f-4f43-99e8-92b55de0dd3d tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:34.908774 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a1a1b6db-709f-4f43-99e8-92b55de0dd3d tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:34.909749 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a1a1b6db-709f-4f43-99e8-92b55de0dd3d tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:34.910431 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a1a1b6db-709f-4f43-99e8-92b55de0dd3d tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:34.911084 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a1a1b6db-709f-4f43-99e8-92b55de0dd3d tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:35.078076 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-a1a1b6db-709f-4f43-99e8-92b55de0dd3d tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc1a698f79642088bb13b3b40d25dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4043f98c7544df8d2ad8152faf5299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:35.086763 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-a1a1b6db-709f-4f43-99e8-92b55de0dd3d tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] 10.222.0.16 "GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38" status: 200 len: 1315 microversion: 2.1 time: 0.192842 Oct 17 03:54:35.087372 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 52/109] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:34 2022] GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38 => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:35.248438 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-9c7f9454-51bf-4dd4-ba26-941c8b7755f8 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:35.249069 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-9c7f9454-51bf-4dd4-ba26-941c8b7755f8 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 15a2e41f-4480-429c-9207-8d95daa186f5] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:35.255463 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-9c7f9454-51bf-4dd4-ba26-941c8b7755f8 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:35.256128 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-9c7f9454-51bf-4dd4-ba26-941c8b7755f8 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:35.256858 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-9c7f9454-51bf-4dd4-ba26-941c8b7755f8 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:35.258258 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-9c7f9454-51bf-4dd4-ba26-941c8b7755f8 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:35.258907 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-9c7f9454-51bf-4dd4-ba26-941c8b7755f8 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:35.259555 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-9c7f9454-51bf-4dd4-ba26-941c8b7755f8 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:35.403500 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-9c7f9454-51bf-4dd4-ba26-941c8b7755f8 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:35.411763 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-9c7f9454-51bf-4dd4-ba26-941c8b7755f8 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5" status: 200 len: 1322 microversion: 2.1 time: 0.167966 Oct 17 03:54:35.412324 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 53/110] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:35 2022] GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:35.579638 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [req-4a1c07ec-0bef-4b54-bd52-0ecffc8dc011 req-4ebc64ea-c0a4-45df-b999-6936665bce6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff49fd54-9ddf-415d-8eb4-fb1b0bef634c", "name": "network-vif-plugged", "status": "completed", "tag": "f99713b4-2587-4880-bc02-eb025501171c"}]} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:54:35.590219 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-4a1c07ec-0bef-4b54-bd52-0ecffc8dc011 req-4ebc64ea-c0a4-45df-b999-6936665bce6d service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:35.590609 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-4a1c07ec-0bef-4b54-bd52-0ecffc8dc011 req-4ebc64ea-c0a4-45df-b999-6936665bce6d service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:35.591207 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-4a1c07ec-0bef-4b54-bd52-0ecffc8dc011 req-4ebc64ea-c0a4-45df-b999-6936665bce6d service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:35.603341 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.compute.server_external_events [req-4a1c07ec-0bef-4b54-bd52-0ecffc8dc011 req-4ebc64ea-c0a4-45df-b999-6936665bce6d service nova] Creating event network-vif-plugged:f99713b4-2587-4880-bc02-eb025501171c for instance ff49fd54-9ddf-415d-8eb4-fb1b0bef634c on hv-cinder-81558 Oct 17 03:54:35.612674 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [req-4a1c07ec-0bef-4b54-bd52-0ecffc8dc011 req-4ebc64ea-c0a4-45df-b999-6936665bce6d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.391441 Oct 17 03:54:35.613793 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 58/111] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 03:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 03:54:35.628244 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-5c4eb43b-2d1f-4b5e-b7fc-f32bfd5baf89 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:35.630549 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-5c4eb43b-2d1f-4b5e-b7fc-f32bfd5baf89 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: ff49fd54-9ddf-415d-8eb4-fb1b0bef634c] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:35.642677 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5c4eb43b-2d1f-4b5e-b7fc-f32bfd5baf89 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:35.642677 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5c4eb43b-2d1f-4b5e-b7fc-f32bfd5baf89 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:35.642677 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5c4eb43b-2d1f-4b5e-b7fc-f32bfd5baf89 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:35.642677 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5c4eb43b-2d1f-4b5e-b7fc-f32bfd5baf89 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:35.642969 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5c4eb43b-2d1f-4b5e-b7fc-f32bfd5baf89 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:35.643444 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5c4eb43b-2d1f-4b5e-b7fc-f32bfd5baf89 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:35.655125 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-c5b9d209-87db-49c0-9b6c-9ffc862b710d tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:35.657307 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-c5b9d209-87db-49c0-9b6c-9ffc862b710d tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:35.668983 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c5b9d209-87db-49c0-9b6c-9ffc862b710d tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:35.673564 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c5b9d209-87db-49c0-9b6c-9ffc862b710d tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:35.674255 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c5b9d209-87db-49c0-9b6c-9ffc862b710d tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:35.675595 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c5b9d209-87db-49c0-9b6c-9ffc862b710d tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:35.676269 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c5b9d209-87db-49c0-9b6c-9ffc862b710d tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:35.676905 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c5b9d209-87db-49c0-9b6c-9ffc862b710d tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:35.864721 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-c5b9d209-87db-49c0-9b6c-9ffc862b710d tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:35.874834 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-c5b9d209-87db-49c0-9b6c-9ffc862b710d tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1362 microversion: 2.1 time: 0.224250 Oct 17 03:54:35.879920 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 59/112] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:35 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1362 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:54:36.111798 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-ce66505f-21c2-4d25-b650-64f0e2ae2677 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:36.112641 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-ce66505f-21c2-4d25-b650-64f0e2ae2677 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] [instance: b2c3871a-d117-4e6c-99c5-14777380ba38] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:36.119406 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ce66505f-21c2-4d25-b650-64f0e2ae2677 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:36.119904 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ce66505f-21c2-4d25-b650-64f0e2ae2677 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:36.120342 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ce66505f-21c2-4d25-b650-64f0e2ae2677 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:36.121042 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ce66505f-21c2-4d25-b650-64f0e2ae2677 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:36.121497 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ce66505f-21c2-4d25-b650-64f0e2ae2677 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:36.122138 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ce66505f-21c2-4d25-b650-64f0e2ae2677 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:36.166872 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-5c4eb43b-2d1f-4b5e-b7fc-f32bfd5baf89 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:36.172380 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-5c4eb43b-2d1f-4b5e-b7fc-f32bfd5baf89 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c" status: 200 len: 1366 microversion: 2.1 time: 0.548844 Oct 17 03:54:36.173068 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 54/113] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:35 2022] GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c => generated 1366 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:36.264785 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-ce66505f-21c2-4d25-b650-64f0e2ae2677 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc1a698f79642088bb13b3b40d25dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4043f98c7544df8d2ad8152faf5299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:36.276217 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-ce66505f-21c2-4d25-b650-64f0e2ae2677 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] 10.222.0.16 "GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38" status: 200 len: 1315 microversion: 2.1 time: 0.170269 Oct 17 03:54:36.277408 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 60/114] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:36 2022] GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:54:36.435639 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-dde81157-d895-46db-bcba-fd8c0698e272 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:36.435639 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-dde81157-d895-46db-bcba-fd8c0698e272 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 15a2e41f-4480-429c-9207-8d95daa186f5] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:36.441224 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-dde81157-d895-46db-bcba-fd8c0698e272 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:36.441773 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-dde81157-d895-46db-bcba-fd8c0698e272 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:36.442384 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-dde81157-d895-46db-bcba-fd8c0698e272 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:36.443272 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-dde81157-d895-46db-bcba-fd8c0698e272 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:36.444080 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-dde81157-d895-46db-bcba-fd8c0698e272 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:36.444814 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-dde81157-d895-46db-bcba-fd8c0698e272 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:36.740702 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-dde81157-d895-46db-bcba-fd8c0698e272 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:36.746726 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-dde81157-d895-46db-bcba-fd8c0698e272 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5" status: 200 len: 1322 microversion: 2.1 time: 0.316675 Oct 17 03:54:36.753817 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 55/115] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:36 2022] GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5 => generated 1322 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:36.897928 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-3d1b1bc6-42dd-4a5f-8715-948c1f047644 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:36.898544 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-3d1b1bc6-42dd-4a5f-8715-948c1f047644 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:36.905786 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-3d1b1bc6-42dd-4a5f-8715-948c1f047644 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:36.906286 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-3d1b1bc6-42dd-4a5f-8715-948c1f047644 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:36.906719 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-3d1b1bc6-42dd-4a5f-8715-948c1f047644 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:36.907456 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-3d1b1bc6-42dd-4a5f-8715-948c1f047644 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:36.907912 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-3d1b1bc6-42dd-4a5f-8715-948c1f047644 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:36.908514 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-3d1b1bc6-42dd-4a5f-8715-948c1f047644 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:37.079663 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-3d1b1bc6-42dd-4a5f-8715-948c1f047644 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:37.093182 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-3d1b1bc6-42dd-4a5f-8715-948c1f047644 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1362 microversion: 2.1 time: 0.198345 Oct 17 03:54:37.094740 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 61/116] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:36 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1362 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:54:37.194740 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-d179210b-de8f-49ac-87aa-6f601f946391 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:37.195380 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-d179210b-de8f-49ac-87aa-6f601f946391 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: ff49fd54-9ddf-415d-8eb4-fb1b0bef634c] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:37.202394 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d179210b-de8f-49ac-87aa-6f601f946391 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:37.202881 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d179210b-de8f-49ac-87aa-6f601f946391 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:37.203339 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d179210b-de8f-49ac-87aa-6f601f946391 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:37.204191 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d179210b-de8f-49ac-87aa-6f601f946391 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:37.204636 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d179210b-de8f-49ac-87aa-6f601f946391 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:37.205290 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d179210b-de8f-49ac-87aa-6f601f946391 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:37.300594 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-9d5eea38-faae-4416-a1de-f559aaa226f6 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:37.301962 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-9d5eea38-faae-4416-a1de-f559aaa226f6 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] [instance: b2c3871a-d117-4e6c-99c5-14777380ba38] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:37.308585 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-9d5eea38-faae-4416-a1de-f559aaa226f6 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:37.309611 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-9d5eea38-faae-4416-a1de-f559aaa226f6 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:37.310362 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-9d5eea38-faae-4416-a1de-f559aaa226f6 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:37.311512 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-9d5eea38-faae-4416-a1de-f559aaa226f6 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:37.312261 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-9d5eea38-faae-4416-a1de-f559aaa226f6 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:37.313005 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-9d5eea38-faae-4416-a1de-f559aaa226f6 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:37.367383 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-d179210b-de8f-49ac-87aa-6f601f946391 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:37.376910 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-d179210b-de8f-49ac-87aa-6f601f946391 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c" status: 200 len: 1366 microversion: 2.1 time: 0.184180 Oct 17 03:54:37.378681 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 56/117] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:37 2022] GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:37.478296 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-9d5eea38-faae-4416-a1de-f559aaa226f6 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc1a698f79642088bb13b3b40d25dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4043f98c7544df8d2ad8152faf5299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:37.485898 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-9d5eea38-faae-4416-a1de-f559aaa226f6 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] 10.222.0.16 "GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38" status: 200 len: 1315 microversion: 2.1 time: 0.189817 Oct 17 03:54:37.486464 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 62/118] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:37 2022] GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38 => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:37.642404 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [req-9aa1503a-f18d-42de-969f-b603ae162ef6 req-65c2716a-2e17-4230-9ec5-7d677201fb78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06e9c5ca-8770-4ed5-90ae-bad248ab7ff7", "name": "network-vif-plugged", "status": "completed", "tag": "2e6c9011-7760-4042-9cfb-b70dfe1712a5"}, {"server_uuid": "b2c3871a-d117-4e6c-99c5-14777380ba38", "name": "network-vif-plugged", "status": "completed", "tag": "10a4687c-7980-411a-8dd5-9ce3d9f6bad5"}, {"server_uuid": "15a2e41f-4480-429c-9207-8d95daa186f5", "name": "network-vif-plugged", "status": "completed", "tag": "d40b4ca9-61e5-4ad3-89cf-f8e01e08a864"}]} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:54:37.654218 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-9aa1503a-f18d-42de-969f-b603ae162ef6 req-65c2716a-2e17-4230-9ec5-7d677201fb78 service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:37.654920 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-9aa1503a-f18d-42de-969f-b603ae162ef6 req-65c2716a-2e17-4230-9ec5-7d677201fb78 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:37.655790 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-9aa1503a-f18d-42de-969f-b603ae162ef6 req-65c2716a-2e17-4230-9ec5-7d677201fb78 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:37.672566 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.compute.server_external_events [req-9aa1503a-f18d-42de-969f-b603ae162ef6 req-65c2716a-2e17-4230-9ec5-7d677201fb78 service nova] Creating event network-vif-plugged:2e6c9011-7760-4042-9cfb-b70dfe1712a5 for instance 06e9c5ca-8770-4ed5-90ae-bad248ab7ff7 on hv-cinder-81558 Oct 17 03:54:37.673066 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.compute.server_external_events [req-9aa1503a-f18d-42de-969f-b603ae162ef6 req-65c2716a-2e17-4230-9ec5-7d677201fb78 service nova] Creating event network-vif-plugged:10a4687c-7980-411a-8dd5-9ce3d9f6bad5 for instance b2c3871a-d117-4e6c-99c5-14777380ba38 on hv-cinder-81558 Oct 17 03:54:37.673619 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.compute.server_external_events [req-9aa1503a-f18d-42de-969f-b603ae162ef6 req-65c2716a-2e17-4230-9ec5-7d677201fb78 service nova] Creating event network-vif-plugged:d40b4ca9-61e5-4ad3-89cf-f8e01e08a864 for instance 15a2e41f-4480-429c-9207-8d95daa186f5 on hv-cinder-81558 Oct 17 03:54:37.682218 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [req-9aa1503a-f18d-42de-969f-b603ae162ef6 req-65c2716a-2e17-4230-9ec5-7d677201fb78 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.044299 Oct 17 03:54:37.682829 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 57/119] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 03:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:54:37.770797 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-0ea2878c-6919-4c56-a2ab-44d33cdffc6f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:37.771452 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-0ea2878c-6919-4c56-a2ab-44d33cdffc6f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 15a2e41f-4480-429c-9207-8d95daa186f5] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:37.777549 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0ea2878c-6919-4c56-a2ab-44d33cdffc6f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:37.778008 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0ea2878c-6919-4c56-a2ab-44d33cdffc6f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:37.778444 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0ea2878c-6919-4c56-a2ab-44d33cdffc6f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:37.779135 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0ea2878c-6919-4c56-a2ab-44d33cdffc6f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:37.779686 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0ea2878c-6919-4c56-a2ab-44d33cdffc6f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:37.780138 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0ea2878c-6919-4c56-a2ab-44d33cdffc6f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:37.919619 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-0ea2878c-6919-4c56-a2ab-44d33cdffc6f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:37.932132 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-0ea2878c-6919-4c56-a2ab-44d33cdffc6f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5" status: 200 len: 1322 microversion: 2.1 time: 0.165465 Oct 17 03:54:37.932723 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 63/120] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:37 2022] GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:38.117647 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-69df03f7-c366-464d-9b00-49513eaf326c tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:38.118504 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-69df03f7-c366-464d-9b00-49513eaf326c tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:38.125316 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-69df03f7-c366-464d-9b00-49513eaf326c tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:38.125873 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-69df03f7-c366-464d-9b00-49513eaf326c tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:38.126370 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-69df03f7-c366-464d-9b00-49513eaf326c tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:38.127216 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-69df03f7-c366-464d-9b00-49513eaf326c tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:38.127715 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-69df03f7-c366-464d-9b00-49513eaf326c tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:38.128198 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-69df03f7-c366-464d-9b00-49513eaf326c tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:38.350621 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-69df03f7-c366-464d-9b00-49513eaf326c tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:38.360074 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-69df03f7-c366-464d-9b00-49513eaf326c tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1362 microversion: 2.1 time: 0.246909 Oct 17 03:54:38.363009 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 58/121] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:38 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1362 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:38.401232 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-87e84150-2eb7-4916-8377-42b9c33042b5 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:38.401847 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-87e84150-2eb7-4916-8377-42b9c33042b5 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: ff49fd54-9ddf-415d-8eb4-fb1b0bef634c] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:38.410608 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-87e84150-2eb7-4916-8377-42b9c33042b5 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:38.411277 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-87e84150-2eb7-4916-8377-42b9c33042b5 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:38.411978 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-87e84150-2eb7-4916-8377-42b9c33042b5 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:38.412926 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-87e84150-2eb7-4916-8377-42b9c33042b5 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:38.413556 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-87e84150-2eb7-4916-8377-42b9c33042b5 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:38.414202 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-87e84150-2eb7-4916-8377-42b9c33042b5 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:38.509852 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-99498ac8-ee57-46b9-9131-7f5fad0a05a8 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:38.510467 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-99498ac8-ee57-46b9-9131-7f5fad0a05a8 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] [instance: b2c3871a-d117-4e6c-99c5-14777380ba38] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:38.524036 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-99498ac8-ee57-46b9-9131-7f5fad0a05a8 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:38.524577 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-99498ac8-ee57-46b9-9131-7f5fad0a05a8 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:38.525023 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-99498ac8-ee57-46b9-9131-7f5fad0a05a8 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:38.532046 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-99498ac8-ee57-46b9-9131-7f5fad0a05a8 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:38.532783 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-99498ac8-ee57-46b9-9131-7f5fad0a05a8 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:38.533956 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-99498ac8-ee57-46b9-9131-7f5fad0a05a8 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:38.714743 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-87e84150-2eb7-4916-8377-42b9c33042b5 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:38.724336 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-87e84150-2eb7-4916-8377-42b9c33042b5 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c" status: 200 len: 1366 microversion: 2.1 time: 0.325827 Oct 17 03:54:38.724336 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 64/122] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:38 2022] GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c => generated 1366 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:38.794250 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-99498ac8-ee57-46b9-9131-7f5fad0a05a8 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc1a698f79642088bb13b3b40d25dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4043f98c7544df8d2ad8152faf5299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:38.803742 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-99498ac8-ee57-46b9-9131-7f5fad0a05a8 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] 10.222.0.16 "GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38" status: 200 len: 1315 microversion: 2.1 time: 0.298466 Oct 17 03:54:38.805487 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 59/123] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:38 2022] GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38 => generated 1315 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:38.956376 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-41ef1de1-a17c-4bc0-a482-0ec9c26c447f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:38.958373 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-41ef1de1-a17c-4bc0-a482-0ec9c26c447f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 15a2e41f-4480-429c-9207-8d95daa186f5] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:38.968893 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-41ef1de1-a17c-4bc0-a482-0ec9c26c447f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:38.969391 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-41ef1de1-a17c-4bc0-a482-0ec9c26c447f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:38.969830 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-41ef1de1-a17c-4bc0-a482-0ec9c26c447f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:38.972705 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-41ef1de1-a17c-4bc0-a482-0ec9c26c447f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:38.973170 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-41ef1de1-a17c-4bc0-a482-0ec9c26c447f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:38.985543 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-41ef1de1-a17c-4bc0-a482-0ec9c26c447f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:39.134048 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-41ef1de1-a17c-4bc0-a482-0ec9c26c447f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:39.143111 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-41ef1de1-a17c-4bc0-a482-0ec9c26c447f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5" status: 200 len: 1322 microversion: 2.1 time: 0.191979 Oct 17 03:54:39.143741 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 65/124] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:38 2022] GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5 => generated 1322 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:39.388336 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-5287edb0-a936-4dbb-9136-fee369e574cb tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:39.388948 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-5287edb0-a936-4dbb-9136-fee369e574cb tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:39.395698 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5287edb0-a936-4dbb-9136-fee369e574cb tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:39.396364 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5287edb0-a936-4dbb-9136-fee369e574cb tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:39.396794 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5287edb0-a936-4dbb-9136-fee369e574cb tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:39.398983 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5287edb0-a936-4dbb-9136-fee369e574cb tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:39.398983 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5287edb0-a936-4dbb-9136-fee369e574cb tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:39.398983 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5287edb0-a936-4dbb-9136-fee369e574cb tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:39.555810 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-5287edb0-a936-4dbb-9136-fee369e574cb tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:39.566067 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-5287edb0-a936-4dbb-9136-fee369e574cb tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1362 microversion: 2.1 time: 0.181749 Oct 17 03:54:39.566651 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 60/125] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:39 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:39.699652 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [req-604f2a27-1446-456e-8ff4-094d576adc1e req-02e1cbcb-b6a7-47ec-8ca8-4ab4f4044350 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf50abcd-84fd-4541-b899-b6f5dad606fe", "name": "network-vif-plugged", "status": "completed", "tag": "8be4dcfc-e0ee-4198-b87d-22c3d9c49993"}]} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:54:39.710243 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-604f2a27-1446-456e-8ff4-094d576adc1e req-02e1cbcb-b6a7-47ec-8ca8-4ab4f4044350 service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:39.710243 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-604f2a27-1446-456e-8ff4-094d576adc1e req-02e1cbcb-b6a7-47ec-8ca8-4ab4f4044350 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:39.710243 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-604f2a27-1446-456e-8ff4-094d576adc1e req-02e1cbcb-b6a7-47ec-8ca8-4ab4f4044350 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:39.722612 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.compute.server_external_events [req-604f2a27-1446-456e-8ff4-094d576adc1e req-02e1cbcb-b6a7-47ec-8ca8-4ab4f4044350 service nova] Creating event network-vif-plugged:8be4dcfc-e0ee-4198-b87d-22c3d9c49993 for instance bf50abcd-84fd-4541-b899-b6f5dad606fe on hv-cinder-81558 Oct 17 03:54:39.728307 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [req-604f2a27-1446-456e-8ff4-094d576adc1e req-02e1cbcb-b6a7-47ec-8ca8-4ab4f4044350 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033964 Oct 17 03:54:39.729348 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 66/126] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 03:54:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:54:39.745929 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-3f48d63a-9800-49c8-b9da-efd15e2b07de tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:39.746687 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-3f48d63a-9800-49c8-b9da-efd15e2b07de tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: ff49fd54-9ddf-415d-8eb4-fb1b0bef634c] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:39.753603 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3f48d63a-9800-49c8-b9da-efd15e2b07de tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:39.754777 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3f48d63a-9800-49c8-b9da-efd15e2b07de tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:39.755530 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3f48d63a-9800-49c8-b9da-efd15e2b07de tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:39.756717 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3f48d63a-9800-49c8-b9da-efd15e2b07de tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:39.757756 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3f48d63a-9800-49c8-b9da-efd15e2b07de tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:39.758395 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3f48d63a-9800-49c8-b9da-efd15e2b07de tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:39.829948 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-ba212995-b00b-47d9-a135-f8735e289734 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:39.832428 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-ba212995-b00b-47d9-a135-f8735e289734 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] [instance: b2c3871a-d117-4e6c-99c5-14777380ba38] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:39.842663 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ba212995-b00b-47d9-a135-f8735e289734 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:39.843420 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ba212995-b00b-47d9-a135-f8735e289734 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:39.847732 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ba212995-b00b-47d9-a135-f8735e289734 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:39.852201 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ba212995-b00b-47d9-a135-f8735e289734 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:39.852201 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ba212995-b00b-47d9-a135-f8735e289734 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:39.852201 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ba212995-b00b-47d9-a135-f8735e289734 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:39.945335 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-3f48d63a-9800-49c8-b9da-efd15e2b07de tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:39.953341 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-3f48d63a-9800-49c8-b9da-efd15e2b07de tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c" status: 200 len: 1557 microversion: 2.1 time: 0.211372 Oct 17 03:54:39.953933 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 61/127] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:39 2022] GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c => generated 1557 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:39.984324 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-c2a30384-3b36-4abf-819b-062cd3792bf0 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:39.984324 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-c2a30384-3b36-4abf-819b-062cd3792bf0 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: ff49fd54-9ddf-415d-8eb4-fb1b0bef634c] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:39.985320 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c2a30384-3b36-4abf-819b-062cd3792bf0 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:39.985965 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c2a30384-3b36-4abf-819b-062cd3792bf0 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:39.986872 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c2a30384-3b36-4abf-819b-062cd3792bf0 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:39.988402 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c2a30384-3b36-4abf-819b-062cd3792bf0 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:39.989016 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c2a30384-3b36-4abf-819b-062cd3792bf0 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:39.989986 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c2a30384-3b36-4abf-819b-062cd3792bf0 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:40.105358 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-ba212995-b00b-47d9-a135-f8735e289734 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc1a698f79642088bb13b3b40d25dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4043f98c7544df8d2ad8152faf5299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:40.116403 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-ba212995-b00b-47d9-a135-f8735e289734 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] 10.222.0.16 "GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38" status: 200 len: 1315 microversion: 2.1 time: 0.293124 Oct 17 03:54:40.117203 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 67/128] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:39 2022] GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38 => generated 1315 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:40.156210 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-c2a30384-3b36-4abf-819b-062cd3792bf0 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.182837 Oct 17 03:54:40.156810 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 62/129] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Oct 17 03:54:39 2022] GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c/os-interface => generated 285 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:54:40.166077 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-688a7098-e45e-446e-8b8a-648d577b24ca tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:40.166682 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-688a7098-e45e-446e-8b8a-648d577b24ca tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 15a2e41f-4480-429c-9207-8d95daa186f5] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:40.173403 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-688a7098-e45e-446e-8b8a-648d577b24ca tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:40.173883 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-688a7098-e45e-446e-8b8a-648d577b24ca tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:40.174312 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-688a7098-e45e-446e-8b8a-648d577b24ca tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:40.175025 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-688a7098-e45e-446e-8b8a-648d577b24ca tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:40.175502 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-688a7098-e45e-446e-8b8a-648d577b24ca tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:40.175923 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-688a7098-e45e-446e-8b8a-648d577b24ca tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:40.337320 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-688a7098-e45e-446e-8b8a-648d577b24ca tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:40.347786 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-688a7098-e45e-446e-8b8a-648d577b24ca tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5" status: 200 len: 1322 microversion: 2.1 time: 0.185879 Oct 17 03:54:40.349214 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 68/130] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:40 2022] GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5 => generated 1322 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:40.593846 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-5566b800-6fda-4902-bdad-8ffd71ea5667 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:40.596213 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-5566b800-6fda-4902-bdad-8ffd71ea5667 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:40.608784 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5566b800-6fda-4902-bdad-8ffd71ea5667 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:40.609726 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5566b800-6fda-4902-bdad-8ffd71ea5667 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:40.611311 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5566b800-6fda-4902-bdad-8ffd71ea5667 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:40.613220 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5566b800-6fda-4902-bdad-8ffd71ea5667 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:40.614170 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5566b800-6fda-4902-bdad-8ffd71ea5667 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:40.616828 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5566b800-6fda-4902-bdad-8ffd71ea5667 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:40.936572 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-5566b800-6fda-4902-bdad-8ffd71ea5667 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:40.945512 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-5566b800-6fda-4902-bdad-8ffd71ea5667 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1362 microversion: 2.1 time: 0.360193 Oct 17 03:54:40.946960 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 63/131] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:40 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1362 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:41.140331 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-37835b2d-5087-4ed9-beb8-950ca99af60f tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:41.140945 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-37835b2d-5087-4ed9-beb8-950ca99af60f tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] [instance: b2c3871a-d117-4e6c-99c5-14777380ba38] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:41.154134 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-37835b2d-5087-4ed9-beb8-950ca99af60f tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:41.154134 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-37835b2d-5087-4ed9-beb8-950ca99af60f tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:41.154134 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-37835b2d-5087-4ed9-beb8-950ca99af60f tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:41.154134 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-37835b2d-5087-4ed9-beb8-950ca99af60f tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:41.154471 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-37835b2d-5087-4ed9-beb8-950ca99af60f tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:41.154471 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-37835b2d-5087-4ed9-beb8-950ca99af60f tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:41.318393 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-37835b2d-5087-4ed9-beb8-950ca99af60f tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc1a698f79642088bb13b3b40d25dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4043f98c7544df8d2ad8152faf5299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:41.326441 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-37835b2d-5087-4ed9-beb8-950ca99af60f tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] 10.222.0.16 "GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38" status: 200 len: 1315 microversion: 2.1 time: 0.190608 Oct 17 03:54:41.327046 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 69/132] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:41 2022] GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38 => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:41.373975 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-27934b0a-98d6-40dc-a100-56da5c3ecbfb tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:41.375317 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-27934b0a-98d6-40dc-a100-56da5c3ecbfb tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 15a2e41f-4480-429c-9207-8d95daa186f5] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:41.383554 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-27934b0a-98d6-40dc-a100-56da5c3ecbfb tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:41.384513 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-27934b0a-98d6-40dc-a100-56da5c3ecbfb tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:41.385475 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-27934b0a-98d6-40dc-a100-56da5c3ecbfb tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:41.386923 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-27934b0a-98d6-40dc-a100-56da5c3ecbfb tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:41.387828 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-27934b0a-98d6-40dc-a100-56da5c3ecbfb tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:41.389117 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-27934b0a-98d6-40dc-a100-56da5c3ecbfb tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:41.675443 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-27934b0a-98d6-40dc-a100-56da5c3ecbfb tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:41.687777 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-27934b0a-98d6-40dc-a100-56da5c3ecbfb tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5" status: 200 len: 1322 microversion: 2.1 time: 0.319589 Oct 17 03:54:41.688365 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 64/133] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:41 2022] GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5 => generated 1322 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:41.983635 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [req-8ccb417d-e11f-452d-950a-18503b2f8e78 req-2438819f-b9f2-4e67-abac-87094d46e624 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff49fd54-9ddf-415d-8eb4-fb1b0bef634c", "tag": "f99713b4-2587-4880-bc02-eb025501171c"}]} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:54:41.983777 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-2749621e-6cd0-4acb-9b6c-afc15a0744fe tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:41.983777 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-2749621e-6cd0-4acb-9b6c-afc15a0744fe tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:41.997726 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2749621e-6cd0-4acb-9b6c-afc15a0744fe tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:42.000097 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2749621e-6cd0-4acb-9b6c-afc15a0744fe tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:42.000550 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2749621e-6cd0-4acb-9b6c-afc15a0744fe tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:42.001278 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2749621e-6cd0-4acb-9b6c-afc15a0744fe tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:42.004724 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2749621e-6cd0-4acb-9b6c-afc15a0744fe tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:42.010935 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-8ccb417d-e11f-452d-950a-18503b2f8e78 req-2438819f-b9f2-4e67-abac-87094d46e624 service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:42.010935 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-8ccb417d-e11f-452d-950a-18503b2f8e78 req-2438819f-b9f2-4e67-abac-87094d46e624 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:42.011131 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2749621e-6cd0-4acb-9b6c-afc15a0744fe tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:42.011275 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-8ccb417d-e11f-452d-950a-18503b2f8e78 req-2438819f-b9f2-4e67-abac-87094d46e624 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:42.039317 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.compute.server_external_events [req-8ccb417d-e11f-452d-950a-18503b2f8e78 req-2438819f-b9f2-4e67-abac-87094d46e624 service nova] Creating event network-changed:f99713b4-2587-4880-bc02-eb025501171c for instance ff49fd54-9ddf-415d-8eb4-fb1b0bef634c on hv-cinder-81558 Oct 17 03:54:42.044843 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [req-8ccb417d-e11f-452d-950a-18503b2f8e78 req-2438819f-b9f2-4e67-abac-87094d46e624 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073281 Oct 17 03:54:42.049724 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 65/134] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 03:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 03:54:42.240409 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-2749621e-6cd0-4acb-9b6c-afc15a0744fe tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:42.244510 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_cell1:SELECT=100 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:54:42.249914 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-2749621e-6cd0-4acb-9b6c-afc15a0744fe tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1362 microversion: 2.1 time: 0.284762 Oct 17 03:54:42.250703 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 70/135] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:41 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1362 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:54:42.352374 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-0f44dd90-328c-4932-9c50-91e82bb01d01 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:42.353342 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-0f44dd90-328c-4932-9c50-91e82bb01d01 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] [instance: b2c3871a-d117-4e6c-99c5-14777380ba38] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:42.361583 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0f44dd90-328c-4932-9c50-91e82bb01d01 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:42.362568 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0f44dd90-328c-4932-9c50-91e82bb01d01 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:42.363216 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0f44dd90-328c-4932-9c50-91e82bb01d01 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:42.364152 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0f44dd90-328c-4932-9c50-91e82bb01d01 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:42.364882 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0f44dd90-328c-4932-9c50-91e82bb01d01 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:42.365431 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0f44dd90-328c-4932-9c50-91e82bb01d01 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:42.674564 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-0f44dd90-328c-4932-9c50-91e82bb01d01 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc1a698f79642088bb13b3b40d25dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4043f98c7544df8d2ad8152faf5299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:42.683599 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-0f44dd90-328c-4932-9c50-91e82bb01d01 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] 10.222.0.16 "GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38" status: 200 len: 1502 microversion: 2.1 time: 0.337706 Oct 17 03:54:42.686685 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 66/136] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:42 2022] GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38 => generated 1502 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:42.711861 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-668c4758-b266-4eb5-b116-bbc2abf8b497 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:42.712507 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-668c4758-b266-4eb5-b116-bbc2abf8b497 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 15a2e41f-4480-429c-9207-8d95daa186f5] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:42.719094 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-668c4758-b266-4eb5-b116-bbc2abf8b497 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:42.719688 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-668c4758-b266-4eb5-b116-bbc2abf8b497 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:42.720300 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-668c4758-b266-4eb5-b116-bbc2abf8b497 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:42.721481 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-668c4758-b266-4eb5-b116-bbc2abf8b497 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:42.722087 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-668c4758-b266-4eb5-b116-bbc2abf8b497 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:42.723549 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-668c4758-b266-4eb5-b116-bbc2abf8b497 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:42.913676 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-668c4758-b266-4eb5-b116-bbc2abf8b497 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:42.922908 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-668c4758-b266-4eb5-b116-bbc2abf8b497 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5" status: 200 len: 1515 microversion: 2.1 time: 0.216704 Oct 17 03:54:42.927203 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 71/137] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:42 2022] GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5 => generated 1515 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:42.947029 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-03db0ac4-cbd2-4930-8840-d054c18b37ca tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:54:42.949300 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-03db0ac4-cbd2-4930-8840-d054c18b37ca tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 15a2e41f-4480-429c-9207-8d95daa186f5] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:42.955360 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-03db0ac4-cbd2-4930-8840-d054c18b37ca tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:42.956228 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-03db0ac4-cbd2-4930-8840-d054c18b37ca tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:42.956669 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-03db0ac4-cbd2-4930-8840-d054c18b37ca tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:42.957364 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-03db0ac4-cbd2-4930-8840-d054c18b37ca tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:42.957822 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-03db0ac4-cbd2-4930-8840-d054c18b37ca tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:42.958246 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-03db0ac4-cbd2-4930-8840-d054c18b37ca tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:42.986535 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.objects.instance [None req-03db0ac4-cbd2-4930-8840-d054c18b37ca tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lazy-loading 'flavor' on Instance uuid 15a2e41f-4480-429c-9207-8d95daa186f5 {{(pid=125871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:54:43.219702 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:54:43.274011 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-c17a96c6-a168-4773-b2c1-10855ddd5a2d tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:43.275228 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-c17a96c6-a168-4773-b2c1-10855ddd5a2d tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:43.282318 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c17a96c6-a168-4773-b2c1-10855ddd5a2d tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:43.282819 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c17a96c6-a168-4773-b2c1-10855ddd5a2d tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:43.283452 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c17a96c6-a168-4773-b2c1-10855ddd5a2d tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:43.284143 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c17a96c6-a168-4773-b2c1-10855ddd5a2d tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:43.284593 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c17a96c6-a168-4773-b2c1-10855ddd5a2d tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:43.285008 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c17a96c6-a168-4773-b2c1-10855ddd5a2d tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:43.300470 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-03db0ac4-cbd2-4930-8840-d054c18b37ca tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "POST /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5/action" status: 200 len: 32 microversion: 2.1 time: 0.357252 Oct 17 03:54:43.303074 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 67/138] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 17 03:54:42 2022] POST /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5/action => generated 32 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 03:54:43.317558 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-94ca6874-e422-4035-94ec-78dec7f7c412 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:43.318631 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-94ca6874-e422-4035-94ec-78dec7f7c412 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 15a2e41f-4480-429c-9207-8d95daa186f5] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:43.338721 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-94ca6874-e422-4035-94ec-78dec7f7c412 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:43.339547 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-94ca6874-e422-4035-94ec-78dec7f7c412 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:43.340081 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-94ca6874-e422-4035-94ec-78dec7f7c412 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:43.340894 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-94ca6874-e422-4035-94ec-78dec7f7c412 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:43.341619 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-94ca6874-e422-4035-94ec-78dec7f7c412 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:43.342811 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-94ca6874-e422-4035-94ec-78dec7f7c412 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:43.536421 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-c17a96c6-a168-4773-b2c1-10855ddd5a2d tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:43.545189 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-c17a96c6-a168-4773-b2c1-10855ddd5a2d tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1362 microversion: 2.1 time: 0.275506 Oct 17 03:54:43.547091 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 72/139] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:43 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1362 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:54:43.663725 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-94ca6874-e422-4035-94ec-78dec7f7c412 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:43.672273 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-94ca6874-e422-4035-94ec-78dec7f7c412 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5" status: 200 len: 1521 microversion: 2.1 time: 0.362442 Oct 17 03:54:43.673346 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 68/140] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:43 2022] GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5 => generated 1521 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:44.537220 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-f1655420-ad2f-46dc-a590-a02d6f4e6ca6 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e112b948-b46d-4785-ad81-4520aa18a5eb"}} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:54:44.539636 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-f1655420-ad2f-46dc-a590-a02d6f4e6ca6 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] [instance: b2c3871a-d117-4e6c-99c5-14777380ba38] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:44.546463 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f1655420-ad2f-46dc-a590-a02d6f4e6ca6 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:44.546953 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f1655420-ad2f-46dc-a590-a02d6f4e6ca6 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:44.547507 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f1655420-ad2f-46dc-a590-a02d6f4e6ca6 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:44.548208 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f1655420-ad2f-46dc-a590-a02d6f4e6ca6 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:44.548693 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f1655420-ad2f-46dc-a590-a02d6f4e6ca6 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:44.553253 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f1655420-ad2f-46dc-a590-a02d6f4e6ca6 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:44.572147 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-222d0792-e6bd-44b4-a501-a1e1fd88cd99 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:44.572718 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-222d0792-e6bd-44b4-a501-a1e1fd88cd99 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:44.584103 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-222d0792-e6bd-44b4-a501-a1e1fd88cd99 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:44.584820 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-222d0792-e6bd-44b4-a501-a1e1fd88cd99 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:44.585341 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-222d0792-e6bd-44b4-a501-a1e1fd88cd99 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:44.586110 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-222d0792-e6bd-44b4-a501-a1e1fd88cd99 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:44.586631 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-222d0792-e6bd-44b4-a501-a1e1fd88cd99 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:44.587279 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-222d0792-e6bd-44b4-a501-a1e1fd88cd99 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:44.756192 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-222d0792-e6bd-44b4-a501-a1e1fd88cd99 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:44.765256 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-222d0792-e6bd-44b4-a501-a1e1fd88cd99 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1549 microversion: 2.1 time: 0.199634 Oct 17 03:54:44.765841 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 69/141] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:44 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1549 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:54:44.770521 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-5efb8d64-de6a-4ed5-9be3-2672812d1e60 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:44.771136 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-5efb8d64-de6a-4ed5-9be3-2672812d1e60 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 15a2e41f-4480-429c-9207-8d95daa186f5] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:44.777766 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5efb8d64-de6a-4ed5-9be3-2672812d1e60 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:44.778255 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5efb8d64-de6a-4ed5-9be3-2672812d1e60 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:44.778697 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5efb8d64-de6a-4ed5-9be3-2672812d1e60 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:44.781991 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5efb8d64-de6a-4ed5-9be3-2672812d1e60 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:44.781991 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5efb8d64-de6a-4ed5-9be3-2672812d1e60 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:44.781991 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5efb8d64-de6a-4ed5-9be3-2672812d1e60 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:44.911144 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-5efb8d64-de6a-4ed5-9be3-2672812d1e60 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:44.919213 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-5efb8d64-de6a-4ed5-9be3-2672812d1e60 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5" status: 200 len: 1521 microversion: 2.1 time: 0.152333 Oct 17 03:54:44.919822 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 70/142] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:44 2022] GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:44.924473 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-a63282e3-6aed-4fec-9342-a5e866bd45ee tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:44.925918 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-a63282e3-6aed-4fec-9342-a5e866bd45ee tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:44.930722 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a63282e3-6aed-4fec-9342-a5e866bd45ee tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:44.933089 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a63282e3-6aed-4fec-9342-a5e866bd45ee tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:44.933541 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a63282e3-6aed-4fec-9342-a5e866bd45ee tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:44.934248 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a63282e3-6aed-4fec-9342-a5e866bd45ee tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:44.934706 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a63282e3-6aed-4fec-9342-a5e866bd45ee tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:44.935135 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a63282e3-6aed-4fec-9342-a5e866bd45ee tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:45.026345 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-a63282e3-6aed-4fec-9342-a5e866bd45ee tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.105239 Oct 17 03:54:45.035260 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 71/143] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Oct 17 03:54:44 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe/os-interface => generated 285 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:54:45.497614 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-f1655420-ad2f-46dc-a590-a02d6f4e6ca6 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] 10.222.0.16 "POST /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.964134 Oct 17 03:54:45.504984 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 73/144] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Oct 17 03:54:44 2022] POST /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38/os-volume_attachments => generated 194 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:54:45.944080 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-70ee97b8-ade1-4d37-8c00-e64a76dbc305 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:45.945287 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-70ee97b8-ade1-4d37-8c00-e64a76dbc305 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 15a2e41f-4480-429c-9207-8d95daa186f5] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:45.962927 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-70ee97b8-ade1-4d37-8c00-e64a76dbc305 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:45.964171 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-70ee97b8-ade1-4d37-8c00-e64a76dbc305 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:45.965098 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-70ee97b8-ade1-4d37-8c00-e64a76dbc305 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:45.967458 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-70ee97b8-ade1-4d37-8c00-e64a76dbc305 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:45.968380 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-70ee97b8-ade1-4d37-8c00-e64a76dbc305 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:45.969033 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-70ee97b8-ade1-4d37-8c00-e64a76dbc305 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:46.153864 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-70ee97b8-ade1-4d37-8c00-e64a76dbc305 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:46.170082 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-70ee97b8-ade1-4d37-8c00-e64a76dbc305 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5" status: 200 len: 1521 microversion: 2.1 time: 0.224989 Oct 17 03:54:46.170082 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 72/145] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:45 2022] GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5 => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:46.646130 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [req-9819874b-0a2b-4280-a058-5daa5dcd0308 req-95a67345-cb34-4790-8bc9-aafdbe0f8271 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf50abcd-84fd-4541-b899-b6f5dad606fe", "tag": "8be4dcfc-e0ee-4198-b87d-22c3d9c49993"}]} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:54:46.673000 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-9819874b-0a2b-4280-a058-5daa5dcd0308 req-95a67345-cb34-4790-8bc9-aafdbe0f8271 service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:46.673000 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-9819874b-0a2b-4280-a058-5daa5dcd0308 req-95a67345-cb34-4790-8bc9-aafdbe0f8271 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:46.673000 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-9819874b-0a2b-4280-a058-5daa5dcd0308 req-95a67345-cb34-4790-8bc9-aafdbe0f8271 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:46.673000 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.compute.server_external_events [req-9819874b-0a2b-4280-a058-5daa5dcd0308 req-95a67345-cb34-4790-8bc9-aafdbe0f8271 service nova] Creating event network-changed:8be4dcfc-e0ee-4198-b87d-22c3d9c49993 for instance bf50abcd-84fd-4541-b899-b6f5dad606fe on hv-cinder-81558 Oct 17 03:54:46.675716 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [req-9819874b-0a2b-4280-a058-5daa5dcd0308 req-95a67345-cb34-4790-8bc9-aafdbe0f8271 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034204 Oct 17 03:54:46.676685 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 74/146] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 03:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:54:47.189541 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-efb09161-f721-43a0-9c55-fe9f0cd21bfd tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:47.190145 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-efb09161-f721-43a0-9c55-fe9f0cd21bfd tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 15a2e41f-4480-429c-9207-8d95daa186f5] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:47.197884 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-efb09161-f721-43a0-9c55-fe9f0cd21bfd tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:47.198590 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-efb09161-f721-43a0-9c55-fe9f0cd21bfd tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:47.199198 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-efb09161-f721-43a0-9c55-fe9f0cd21bfd tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:47.200150 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-efb09161-f721-43a0-9c55-fe9f0cd21bfd tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:47.200612 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-efb09161-f721-43a0-9c55-fe9f0cd21bfd tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:47.201285 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-efb09161-f721-43a0-9c55-fe9f0cd21bfd tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:47.427539 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-efb09161-f721-43a0-9c55-fe9f0cd21bfd tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:47.436246 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-efb09161-f721-43a0-9c55-fe9f0cd21bfd tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5" status: 200 len: 1521 microversion: 2.1 time: 0.251299 Oct 17 03:54:47.437967 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 73/147] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:47 2022] GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5 => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:48.461735 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-1624ea1e-ee0e-4210-be35-08d71bc14e56 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:48.470319 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-1624ea1e-ee0e-4210-be35-08d71bc14e56 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 15a2e41f-4480-429c-9207-8d95daa186f5] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:48.477265 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_api:SELECT=97 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:54:48.480715 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1624ea1e-ee0e-4210-be35-08d71bc14e56 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:48.480715 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1624ea1e-ee0e-4210-be35-08d71bc14e56 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:48.480715 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1624ea1e-ee0e-4210-be35-08d71bc14e56 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:48.482961 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1624ea1e-ee0e-4210-be35-08d71bc14e56 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:48.483653 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1624ea1e-ee0e-4210-be35-08d71bc14e56 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:48.484324 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1624ea1e-ee0e-4210-be35-08d71bc14e56 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:48.659387 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-1624ea1e-ee0e-4210-be35-08d71bc14e56 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:48.669447 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-1624ea1e-ee0e-4210-be35-08d71bc14e56 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5" status: 200 len: 1521 microversion: 2.1 time: 0.212387 Oct 17 03:54:48.680224 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 75/148] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:48 2022] GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5 => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:49.255148 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-0a1883c6-3a7c-4436-ab41-92fd53313cd1 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:49.255877 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-0a1883c6-3a7c-4436-ab41-92fd53313cd1 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] [instance: b2c3871a-d117-4e6c-99c5-14777380ba38] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:49.265567 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0a1883c6-3a7c-4436-ab41-92fd53313cd1 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:49.266143 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0a1883c6-3a7c-4436-ab41-92fd53313cd1 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:49.266760 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0a1883c6-3a7c-4436-ab41-92fd53313cd1 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:49.267833 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0a1883c6-3a7c-4436-ab41-92fd53313cd1 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:49.268372 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0a1883c6-3a7c-4436-ab41-92fd53313cd1 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:49.268920 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0a1883c6-3a7c-4436-ab41-92fd53313cd1 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:49.300820 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-0a1883c6-3a7c-4436-ab41-92fd53313cd1 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] [instance: b2c3871a-d117-4e6c-99c5-14777380ba38] Going to try to terminate instance {{(pid=125871) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 03:54:49.671234 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-0a1883c6-3a7c-4436-ab41-92fd53313cd1 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38" status: 204 len: 0 microversion: 2.1 time: 0.420140 Oct 17 03:54:49.682621 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 74/149] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 17 03:54:49 2022] DELETE /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 03:54:49.691651 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-3a6413e4-2b6c-4d9f-97ec-348b5180f51f tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:49.692263 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-3a6413e4-2b6c-4d9f-97ec-348b5180f51f tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] [instance: b2c3871a-d117-4e6c-99c5-14777380ba38] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:49.693390 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-9937756f-1506-4d00-a14a-966443c646ae tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:49.694274 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-9937756f-1506-4d00-a14a-966443c646ae tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 15a2e41f-4480-429c-9207-8d95daa186f5] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:49.703469 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-3a6413e4-2b6c-4d9f-97ec-348b5180f51f tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:49.714215 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-3a6413e4-2b6c-4d9f-97ec-348b5180f51f tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:49.714215 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-3a6413e4-2b6c-4d9f-97ec-348b5180f51f tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:49.714455 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-9937756f-1506-4d00-a14a-966443c646ae tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:49.714546 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-3a6413e4-2b6c-4d9f-97ec-348b5180f51f tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:49.714620 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-9937756f-1506-4d00-a14a-966443c646ae tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:49.714698 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-3a6413e4-2b6c-4d9f-97ec-348b5180f51f tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:49.714769 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-9937756f-1506-4d00-a14a-966443c646ae tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:49.714851 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-3a6413e4-2b6c-4d9f-97ec-348b5180f51f tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:49.714923 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-9937756f-1506-4d00-a14a-966443c646ae tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:49.714923 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-9937756f-1506-4d00-a14a-966443c646ae tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:49.714923 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-9937756f-1506-4d00-a14a-966443c646ae tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:49.923396 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-3a6413e4-2b6c-4d9f-97ec-348b5180f51f tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc1a698f79642088bb13b3b40d25dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4043f98c7544df8d2ad8152faf5299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:49.939953 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-3a6413e4-2b6c-4d9f-97ec-348b5180f51f tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] 10.222.0.16 "GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38" status: 200 len: 1554 microversion: 2.1 time: 0.253979 Oct 17 03:54:49.954670 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 76/150] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:49 2022] GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38 => generated 1554 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:49.957829 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-9937756f-1506-4d00-a14a-966443c646ae tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:49.968008 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-9937756f-1506-4d00-a14a-966443c646ae tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5" status: 200 len: 1521 microversion: 2.1 time: 0.278843 Oct 17 03:54:49.970034 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 75/151] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:49 2022] GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5 => generated 1521 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:50.276017 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-fc2b950b-75e5-4723-922b-ed6916e22914 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1449100706", "imageRef": "add1979e-0a3b-4403-a8ae-8d9a7b045fc2", "flavorRef": "452", "networks": [{"uuid": "566ec71d-905c-4297-aabe-ae4c7e8481e9"}]}} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:54:50.335772 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.network.neutron [None req-fc2b950b-75e5-4723-922b-ed6916e22914 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] validate_networks() for [('566ec71d-905c-4297-aabe-ae4c7e8481e9', None, None, None, None, None)] {{(pid=125872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 03:54:50.699104 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.virt.hardware [None req-fc2b950b-75e5-4723-922b-ed6916e22914 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Flavor limits 0:0:0 {{(pid=125872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 03:54:50.701541 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.virt.hardware [None req-fc2b950b-75e5-4723-922b-ed6916e22914 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Image limits 0:0:0 {{(pid=125872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 03:54:50.701541 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.virt.hardware [None req-fc2b950b-75e5-4723-922b-ed6916e22914 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Flavor pref 0:0:0 {{(pid=125872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 03:54:50.701541 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.virt.hardware [None req-fc2b950b-75e5-4723-922b-ed6916e22914 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Image pref 0:0:0 {{(pid=125872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 03:54:50.701541 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.virt.hardware [None req-fc2b950b-75e5-4723-922b-ed6916e22914 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 03:54:50.709866 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-fc2b950b-75e5-4723-922b-ed6916e22914 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:50.710416 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-fc2b950b-75e5-4723-922b-ed6916e22914 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:50.710852 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-fc2b950b-75e5-4723-922b-ed6916e22914 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:50.711613 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-fc2b950b-75e5-4723-922b-ed6916e22914 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:50.712077 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-fc2b950b-75e5-4723-922b-ed6916e22914 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:50.712504 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-fc2b950b-75e5-4723-922b-ed6916e22914 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:50.730527 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.quota [None req-fc2b950b-75e5-4723-922b-ed6916e22914 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Getting quotas for project b1a41912e4cf45cf8409a238d3ed33bf. Resources: {'cores', 'instances', 'ram'} {{(pid=125872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 03:54:50.735134 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.quota [None req-fc2b950b-75e5-4723-922b-ed6916e22914 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Getting quotas for user 445a5503db82419ebb96ac4518e37447 and project b1a41912e4cf45cf8409a238d3ed33bf. Resources: {'cores', 'instances', 'ram'} {{(pid=125872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 03:54:50.746756 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-fc2b950b-75e5-4723-922b-ed6916e22914 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Going to run 1 instances... {{(pid=125872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 03:54:50.749144 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-fc2b950b-75e5-4723-922b-ed6916e22914 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] [instance: 5bced6b7-8194-4fa1-90c6-94251db2b3a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='add1979e-0a3b-4403-a8ae-8d9a7b045fc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 03:54:50.866242 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-fc2b950b-75e5-4723-922b-ed6916e22914 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.712264 Oct 17 03:54:50.867417 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 77/152] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 17 03:54:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 03:54:50.900694 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-1688a810-1b86-4fda-b2a9-83b55fba183c tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:50.901320 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-1688a810-1b86-4fda-b2a9-83b55fba183c tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] [instance: 5bced6b7-8194-4fa1-90c6-94251db2b3a9] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:50.960073 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-1688a810-1b86-4fda-b2a9-83b55fba183c tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445a5503db82419ebb96ac4518e37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1a41912e4cf45cf8409a238d3ed33bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:50.968030 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-1688a810-1b86-4fda-b2a9-83b55fba183c tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] 10.222.0.16 "GET /compute/v2.1/servers/5bced6b7-8194-4fa1-90c6-94251db2b3a9" status: 200 len: 1214 microversion: 2.1 time: 0.078762 Oct 17 03:54:50.969113 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 76/153] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:50 2022] GET /compute/v2.1/servers/5bced6b7-8194-4fa1-90c6-94251db2b3a9 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:50.979341 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-75ca8dbf-eaa7-4668-b04c-fd3a652b2229 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:50.979341 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-75ca8dbf-eaa7-4668-b04c-fd3a652b2229 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] [instance: b2c3871a-d117-4e6c-99c5-14777380ba38] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:50.979341 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-75ca8dbf-eaa7-4668-b04c-fd3a652b2229 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:50.979711 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-75ca8dbf-eaa7-4668-b04c-fd3a652b2229 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:50.979989 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-75ca8dbf-eaa7-4668-b04c-fd3a652b2229 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:50.980835 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-75ca8dbf-eaa7-4668-b04c-fd3a652b2229 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:50.982209 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-75ca8dbf-eaa7-4668-b04c-fd3a652b2229 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:50.983240 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-75ca8dbf-eaa7-4668-b04c-fd3a652b2229 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:50.999728 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-6709cfde-3d72-4e70-b9d0-6cbc046ea3a3 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:51.000654 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-6709cfde-3d72-4e70-b9d0-6cbc046ea3a3 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 15a2e41f-4480-429c-9207-8d95daa186f5] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:51.008058 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-6709cfde-3d72-4e70-b9d0-6cbc046ea3a3 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:51.009224 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-6709cfde-3d72-4e70-b9d0-6cbc046ea3a3 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:51.009662 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-6709cfde-3d72-4e70-b9d0-6cbc046ea3a3 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:51.010371 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-6709cfde-3d72-4e70-b9d0-6cbc046ea3a3 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:51.011098 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-6709cfde-3d72-4e70-b9d0-6cbc046ea3a3 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:51.027916 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-6709cfde-3d72-4e70-b9d0-6cbc046ea3a3 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:51.129329 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-75ca8dbf-eaa7-4668-b04c-fd3a652b2229 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc1a698f79642088bb13b3b40d25dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4043f98c7544df8d2ad8152faf5299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:51.142737 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-75ca8dbf-eaa7-4668-b04c-fd3a652b2229 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] 10.222.0.16 "GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38" status: 200 len: 1554 microversion: 2.1 time: 0.177723 Oct 17 03:54:51.143781 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 78/154] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:50 2022] GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38 => generated 1554 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:54:51.199964 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-6709cfde-3d72-4e70-b9d0-6cbc046ea3a3 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:51.207654 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-6709cfde-3d72-4e70-b9d0-6cbc046ea3a3 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5" status: 200 len: 1521 microversion: 2.1 time: 0.214874 Oct 17 03:54:51.208223 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 77/155] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:50 2022] GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5 => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:54:51.993768 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-3d1a8f5d-4e0b-4d53-8b4e-9c56db33fc88 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:51.996959 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-3d1a8f5d-4e0b-4d53-8b4e-9c56db33fc88 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] [instance: 5bced6b7-8194-4fa1-90c6-94251db2b3a9] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:52.066568 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-3d1a8f5d-4e0b-4d53-8b4e-9c56db33fc88 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445a5503db82419ebb96ac4518e37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1a41912e4cf45cf8409a238d3ed33bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:52.075691 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-3d1a8f5d-4e0b-4d53-8b4e-9c56db33fc88 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] 10.222.0.16 "GET /compute/v2.1/servers/5bced6b7-8194-4fa1-90c6-94251db2b3a9" status: 200 len: 1214 microversion: 2.1 time: 0.086208 Oct 17 03:54:52.083714 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 79/156] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:51 2022] GET /compute/v2.1/servers/5bced6b7-8194-4fa1-90c6-94251db2b3a9 => generated 1214 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:52.166831 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-905e8e50-40d3-4ecf-9ee5-d382a76c68b1 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:52.167467 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-905e8e50-40d3-4ecf-9ee5-d382a76c68b1 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] [instance: b2c3871a-d117-4e6c-99c5-14777380ba38] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:52.173533 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-905e8e50-40d3-4ecf-9ee5-d382a76c68b1 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:52.174010 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-905e8e50-40d3-4ecf-9ee5-d382a76c68b1 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:52.174439 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-905e8e50-40d3-4ecf-9ee5-d382a76c68b1 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:52.175155 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-905e8e50-40d3-4ecf-9ee5-d382a76c68b1 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:52.175631 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-905e8e50-40d3-4ecf-9ee5-d382a76c68b1 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:52.176171 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-905e8e50-40d3-4ecf-9ee5-d382a76c68b1 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:52.231232 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-7eb1db1f-4862-4c98-91e1-2ee520a75f4a tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:52.231849 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-7eb1db1f-4862-4c98-91e1-2ee520a75f4a tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 15a2e41f-4480-429c-9207-8d95daa186f5] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:52.238686 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-7eb1db1f-4862-4c98-91e1-2ee520a75f4a tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:52.239209 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-7eb1db1f-4862-4c98-91e1-2ee520a75f4a tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:52.239641 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-7eb1db1f-4862-4c98-91e1-2ee520a75f4a tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:52.240479 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-7eb1db1f-4862-4c98-91e1-2ee520a75f4a tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:52.240930 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-7eb1db1f-4862-4c98-91e1-2ee520a75f4a tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:52.241512 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-7eb1db1f-4862-4c98-91e1-2ee520a75f4a tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:52.375882 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-905e8e50-40d3-4ecf-9ee5-d382a76c68b1 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc1a698f79642088bb13b3b40d25dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4043f98c7544df8d2ad8152faf5299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:52.382812 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-7eb1db1f-4862-4c98-91e1-2ee520a75f4a tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:52.384569 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-905e8e50-40d3-4ecf-9ee5-d382a76c68b1 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] 10.222.0.16 "GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38" status: 200 len: 1554 microversion: 2.1 time: 0.221865 Oct 17 03:54:52.385944 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 78/157] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:52 2022] GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38 => generated 1554 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:54:52.391156 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-7eb1db1f-4862-4c98-91e1-2ee520a75f4a tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5" status: 200 len: 1521 microversion: 2.1 time: 0.164384 Oct 17 03:54:52.391747 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 80/158] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:52 2022] GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:54:52.610612 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [req-145b2f58-ba30-4d2f-8d91-1598d793a104 req-1336f860-0d3e-4019-b259-ca4d13a2f488 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2c3871a-d117-4e6c-99c5-14777380ba38", "name": "network-vif-deleted", "tag": "10a4687c-7980-411a-8dd5-9ce3d9f6bad5"}]} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:54:52.619606 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:54:52.627912 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-145b2f58-ba30-4d2f-8d91-1598d793a104 req-1336f860-0d3e-4019-b259-ca4d13a2f488 service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:52.628851 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-145b2f58-ba30-4d2f-8d91-1598d793a104 req-1336f860-0d3e-4019-b259-ca4d13a2f488 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:52.629354 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-145b2f58-ba30-4d2f-8d91-1598d793a104 req-1336f860-0d3e-4019-b259-ca4d13a2f488 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:52.642610 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.compute.server_external_events [req-145b2f58-ba30-4d2f-8d91-1598d793a104 req-1336f860-0d3e-4019-b259-ca4d13a2f488 service nova] Creating event network-vif-deleted:10a4687c-7980-411a-8dd5-9ce3d9f6bad5 for instance b2c3871a-d117-4e6c-99c5-14777380ba38 on hv-cinder-81558 Oct 17 03:54:52.651705 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [req-145b2f58-ba30-4d2f-8d91-1598d793a104 req-1336f860-0d3e-4019-b259-ca4d13a2f488 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047264 Oct 17 03:54:52.652961 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 79/159] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 03:54:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:54:53.099860 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-f8bb07e6-7ded-45c4-bdca-bac736f5ff4e tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:53.100480 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-f8bb07e6-7ded-45c4-bdca-bac736f5ff4e tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] [instance: 5bced6b7-8194-4fa1-90c6-94251db2b3a9] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:53.107409 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f8bb07e6-7ded-45c4-bdca-bac736f5ff4e tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:53.107897 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f8bb07e6-7ded-45c4-bdca-bac736f5ff4e tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:53.108341 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f8bb07e6-7ded-45c4-bdca-bac736f5ff4e tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:53.109043 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f8bb07e6-7ded-45c4-bdca-bac736f5ff4e tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:53.109498 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f8bb07e6-7ded-45c4-bdca-bac736f5ff4e tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:53.109931 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f8bb07e6-7ded-45c4-bdca-bac736f5ff4e tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:53.196521 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-f8bb07e6-7ded-45c4-bdca-bac736f5ff4e tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445a5503db82419ebb96ac4518e37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1a41912e4cf45cf8409a238d3ed33bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:53.206872 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-f8bb07e6-7ded-45c4-bdca-bac736f5ff4e tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] 10.222.0.16 "GET /compute/v2.1/servers/5bced6b7-8194-4fa1-90c6-94251db2b3a9" status: 200 len: 1266 microversion: 2.1 time: 0.110731 Oct 17 03:54:53.207490 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 81/160] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:53 2022] GET /compute/v2.1/servers/5bced6b7-8194-4fa1-90c6-94251db2b3a9 => generated 1266 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:53.409070 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-3a4c244e-08ad-4f57-9057-e2e3c7f01cab tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:53.410486 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-3a4c244e-08ad-4f57-9057-e2e3c7f01cab tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] [instance: b2c3871a-d117-4e6c-99c5-14777380ba38] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:53.414087 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-148e12f3-cc51-4b99-ad8b-1d1b4a5802ec tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:53.414707 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-148e12f3-cc51-4b99-ad8b-1d1b4a5802ec tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 15a2e41f-4480-429c-9207-8d95daa186f5] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:53.418795 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3a4c244e-08ad-4f57-9057-e2e3c7f01cab tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:53.419504 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3a4c244e-08ad-4f57-9057-e2e3c7f01cab tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:53.420104 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3a4c244e-08ad-4f57-9057-e2e3c7f01cab tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:53.420938 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3a4c244e-08ad-4f57-9057-e2e3c7f01cab tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:53.421384 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-148e12f3-cc51-4b99-ad8b-1d1b4a5802ec tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:53.421722 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3a4c244e-08ad-4f57-9057-e2e3c7f01cab tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:53.421872 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-148e12f3-cc51-4b99-ad8b-1d1b4a5802ec tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:53.422354 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-148e12f3-cc51-4b99-ad8b-1d1b4a5802ec tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:53.422784 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3a4c244e-08ad-4f57-9057-e2e3c7f01cab tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:53.423054 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-148e12f3-cc51-4b99-ad8b-1d1b4a5802ec tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:53.423764 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-148e12f3-cc51-4b99-ad8b-1d1b4a5802ec tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:53.424350 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-148e12f3-cc51-4b99-ad8b-1d1b4a5802ec tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:53.467467 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3a4c244e-08ad-4f57-9057-e2e3c7f01cab tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:53.468282 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3a4c244e-08ad-4f57-9057-e2e3c7f01cab tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:53.468878 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3a4c244e-08ad-4f57-9057-e2e3c7f01cab tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:53.469457 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.objects.instance [None req-3a4c244e-08ad-4f57-9057-e2e3c7f01cab tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lazy-loading 'fault' on Instance uuid b2c3871a-d117-4e6c-99c5-14777380ba38 {{(pid=125871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:54:53.521536 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-3a4c244e-08ad-4f57-9057-e2e3c7f01cab tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc1a698f79642088bb13b3b40d25dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4043f98c7544df8d2ad8152faf5299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:53.531640 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-3a4c244e-08ad-4f57-9057-e2e3c7f01cab tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] 10.222.0.16 "GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38" status: 200 len: 1351 microversion: 2.1 time: 0.126837 Oct 17 03:54:53.532093 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 80/161] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:53 2022] GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38 => generated 1351 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:54:53.607649 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-148e12f3-cc51-4b99-ad8b-1d1b4a5802ec tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:53.615685 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-148e12f3-cc51-4b99-ad8b-1d1b4a5802ec tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5" status: 200 len: 1521 microversion: 2.1 time: 0.205777 Oct 17 03:54:53.617974 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 82/162] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:53 2022] GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:54.230364 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-1a71b79f-84fb-4763-b297-5274fc7a77b9 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:54.230985 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-1a71b79f-84fb-4763-b297-5274fc7a77b9 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] [instance: 5bced6b7-8194-4fa1-90c6-94251db2b3a9] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:54.237058 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1a71b79f-84fb-4763-b297-5274fc7a77b9 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:54.237551 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1a71b79f-84fb-4763-b297-5274fc7a77b9 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:54.238131 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1a71b79f-84fb-4763-b297-5274fc7a77b9 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:54.238673 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1a71b79f-84fb-4763-b297-5274fc7a77b9 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:54.239328 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1a71b79f-84fb-4763-b297-5274fc7a77b9 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:54.239963 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1a71b79f-84fb-4763-b297-5274fc7a77b9 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:54.313078 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-1a71b79f-84fb-4763-b297-5274fc7a77b9 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445a5503db82419ebb96ac4518e37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1a41912e4cf45cf8409a238d3ed33bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:54.321413 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-1a71b79f-84fb-4763-b297-5274fc7a77b9 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] 10.222.0.16 "GET /compute/v2.1/servers/5bced6b7-8194-4fa1-90c6-94251db2b3a9" status: 200 len: 1284 microversion: 2.1 time: 0.095349 Oct 17 03:54:54.322686 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 81/163] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:54 2022] GET /compute/v2.1/servers/5bced6b7-8194-4fa1-90c6-94251db2b3a9 => generated 1284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:54.553899 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-52bcd2d3-2083-4424-82a5-fde829fe5ee3 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:54.554506 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-52bcd2d3-2083-4424-82a5-fde829fe5ee3 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] [instance: b2c3871a-d117-4e6c-99c5-14777380ba38] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:54.561564 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-52bcd2d3-2083-4424-82a5-fde829fe5ee3 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:54.562050 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-52bcd2d3-2083-4424-82a5-fde829fe5ee3 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:54.562512 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-52bcd2d3-2083-4424-82a5-fde829fe5ee3 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:54.563241 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-52bcd2d3-2083-4424-82a5-fde829fe5ee3 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:54.563745 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-52bcd2d3-2083-4424-82a5-fde829fe5ee3 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:54.564166 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-52bcd2d3-2083-4424-82a5-fde829fe5ee3 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:54.596897 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-52bcd2d3-2083-4424-82a5-fde829fe5ee3 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:54.597387 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-52bcd2d3-2083-4424-82a5-fde829fe5ee3 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:54.597819 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-52bcd2d3-2083-4424-82a5-fde829fe5ee3 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:54.598471 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.objects.instance [None req-52bcd2d3-2083-4424-82a5-fde829fe5ee3 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lazy-loading 'fault' on Instance uuid b2c3871a-d117-4e6c-99c5-14777380ba38 {{(pid=125872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:54:54.644645 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-ac496de0-da49-491b-8091-6b99ae3be107 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:54.645899 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-ac496de0-da49-491b-8091-6b99ae3be107 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 15a2e41f-4480-429c-9207-8d95daa186f5] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:54.656089 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ac496de0-da49-491b-8091-6b99ae3be107 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:54.656819 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ac496de0-da49-491b-8091-6b99ae3be107 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:54.661804 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ac496de0-da49-491b-8091-6b99ae3be107 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:54.662864 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ac496de0-da49-491b-8091-6b99ae3be107 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:54.663537 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ac496de0-da49-491b-8091-6b99ae3be107 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:54.664142 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ac496de0-da49-491b-8091-6b99ae3be107 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:54.677116 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-52bcd2d3-2083-4424-82a5-fde829fe5ee3 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc1a698f79642088bb13b3b40d25dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4043f98c7544df8d2ad8152faf5299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:54.685435 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-52bcd2d3-2083-4424-82a5-fde829fe5ee3 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] 10.222.0.16 "GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38" status: 200 len: 1351 microversion: 2.1 time: 0.135351 Oct 17 03:54:54.686523 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 83/164] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:54 2022] GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38 => generated 1351 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:54.910883 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-ac496de0-da49-491b-8091-6b99ae3be107 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:54.920861 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-ac496de0-da49-491b-8091-6b99ae3be107 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5" status: 200 len: 1521 microversion: 2.1 time: 0.279632 Oct 17 03:54:54.921867 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 82/165] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:54 2022] GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5 => generated 1521 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:55.346181 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-b068aa25-0369-4e04-adda-72d955333d7b tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:55.346801 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-b068aa25-0369-4e04-adda-72d955333d7b tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] [instance: 5bced6b7-8194-4fa1-90c6-94251db2b3a9] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:55.352747 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b068aa25-0369-4e04-adda-72d955333d7b tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:55.353412 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b068aa25-0369-4e04-adda-72d955333d7b tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:55.353989 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b068aa25-0369-4e04-adda-72d955333d7b tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:55.354869 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b068aa25-0369-4e04-adda-72d955333d7b tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:55.355357 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b068aa25-0369-4e04-adda-72d955333d7b tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:55.355935 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b068aa25-0369-4e04-adda-72d955333d7b tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:55.495831 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-b068aa25-0369-4e04-adda-72d955333d7b tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445a5503db82419ebb96ac4518e37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1a41912e4cf45cf8409a238d3ed33bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:55.515783 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-b068aa25-0369-4e04-adda-72d955333d7b tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] 10.222.0.16 "GET /compute/v2.1/servers/5bced6b7-8194-4fa1-90c6-94251db2b3a9" status: 200 len: 1314 microversion: 2.1 time: 0.163696 Oct 17 03:54:55.515783 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 84/166] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:55 2022] GET /compute/v2.1/servers/5bced6b7-8194-4fa1-90c6-94251db2b3a9 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:55.709462 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-3cf814d0-7d86-4364-8196-3a691facba1e tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:55.710079 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-3cf814d0-7d86-4364-8196-3a691facba1e tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] [instance: b2c3871a-d117-4e6c-99c5-14777380ba38] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:55.715985 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3cf814d0-7d86-4364-8196-3a691facba1e tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:55.716830 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3cf814d0-7d86-4364-8196-3a691facba1e tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:55.717492 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3cf814d0-7d86-4364-8196-3a691facba1e tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:55.718326 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3cf814d0-7d86-4364-8196-3a691facba1e tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:55.718920 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3cf814d0-7d86-4364-8196-3a691facba1e tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:55.719557 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3cf814d0-7d86-4364-8196-3a691facba1e tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:55.737876 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.wsgi [None req-3cf814d0-7d86-4364-8196-3a691facba1e tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] HTTP exception thrown: Instance b2c3871a-d117-4e6c-99c5-14777380ba38 could not be found. Oct 17 03:54:55.742578 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-3cf814d0-7d86-4364-8196-3a691facba1e tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Request method failure captured: Oct 17 03:54:55.742578 dv-cinder-815582-16-smb devstack@n-api.service[125871]: request: GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38 HTTP/1.1 Oct 17 03:54:55.742578 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Accept: application/json Oct 17 03:54:55.742578 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Accept-Encoding: identity Oct 17 03:54:55.742578 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Connection: close Oct 17 03:54:55.742578 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Content-Length: 0 Oct 17 03:54:55.742578 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Content-Type: application/json Oct 17 03:54:55.742578 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Host: 10.222.0.16 Oct 17 03:54:55.742578 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Openstack-System-Scope: None Oct 17 03:54:55.742578 dv-cinder-815582-16-smb devstack@n-api.service[125871]: User-Agent: python-urllib3/1.26.12 Oct 17 03:54:55.742578 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Auth-Token: gAAAAABjTNHY3r654DwvOrfgTnUdtTSXEBldPTUrUXvH_Gw_jPhVrCQiJv_SpROKm5Z2vvfHtCxcs5Ab-wl7nxwkmawCScCBE4kXAhM83nZGfDpyUPA19jFQAh-33Tqhe-ZPvhabYHE9IZlxiTBSXCskzaKVuvdJ35KCgR9GcXfgvv5anakCSEc Oct 17 03:54:55.742578 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Domain-Id: None Oct 17 03:54:55.742578 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Domain-Name: None Oct 17 03:54:55.742578 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Identity-Status: Confirmed Oct 17 03:54:55.742578 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Is-Admin-Project: True Oct 17 03:54:55.742578 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Domain-Id: default Oct 17 03:54:55.742578 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Domain-Name: Default Oct 17 03:54:55.742578 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Id: 1b4043f98c7544df8d2ad8152faf5299 Oct 17 03:54:55.742578 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Name: tempest-DeleteServersTestJSON-1098745372 Oct 17 03:54:55.742578 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Role: reader,member Oct 17 03:54:55.742578 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Roles: reader,member Oct 17 03:54:55.747604 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1b4043f98c7544df8d2ad8152faf5299"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1b4043f98c7544df8d2ad8152faf5299"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1b4043f98c7544df8d2ad8152faf5299"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1b4043f98c7544df8d2ad8152faf5299", "adminURL": "http://10.222.0.16:8080"}]}] Oct 17 03:54:55.747604 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant: tempest-DeleteServersTestJSON-1098745372 Oct 17 03:54:55.747604 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant-Id: 1b4043f98c7544df8d2ad8152faf5299 Oct 17 03:54:55.747604 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant-Name: tempest-DeleteServersTestJSON-1098745372 Oct 17 03:54:55.747604 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User: tempest-DeleteServersTestJSON-1098745372-project Oct 17 03:54:55.747604 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Domain-Id: default Oct 17 03:54:55.747604 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Domain-Name: Default Oct 17 03:54:55.747604 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Id: 6fc1a698f79642088bb13b3b40d25dc2 Oct 17 03:54:55.747604 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Name: tempest-DeleteServersTestJSON-1098745372-project Oct 17 03:54:55.747604 dv-cinder-815582-16-smb devstack@n-api.service[125871]: method: > Oct 17 03:54:55.747604 dv-cinder-815582-16-smb devstack@n-api.service[125871]: exception: Instance b2c3871a-d117-4e6c-99c5-14777380ba38 could not be found. Oct 17 03:54:55.747604 dv-cinder-815582-16-smb devstack@n-api.service[125871]: action_args: {'id': 'b2c3871a-d117-4e6c-99c5-14777380ba38'} Oct 17 03:54:55.749422 dv-cinder-815582-16-smb devstack@n-api.service[125871]: {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:54:55.749422 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:54:55.749422 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 03:54:55.749422 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 03:54:55.749422 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 03:54:55.749422 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 03:54:55.749422 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 03:54:55.749422 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 03:54:55.749422 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 03:54:55.749422 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 03:54:55.749422 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2c3871a-d117-4e6c-99c5-14777380ba38 could not be found. Oct 17 03:54:55.749422 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:54:55.749422 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:54:55.749422 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:54:55.749422 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:54:55.749422 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:54:55.749422 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:54:55.749422 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:54:55.749422 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:54:55.749422 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:54:55.750639 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:54:55.750639 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 03:54:55.750639 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 03:54:55.750639 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 03:54:55.750639 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 03:54:55.750639 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 03:54:55.750639 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:54:55.750639 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2c3871a-d117-4e6c-99c5-14777380ba38 could not be found. Oct 17 03:54:55.750639 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:54:55.750639 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:54:55.750639 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:54:55.750639 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:54:55.750639 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:54:55.750639 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:54:55.750639 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:54:55.750639 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:54:55.750639 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2c3871a-d117-4e6c-99c5-14777380ba38 could not be found. Oct 17 03:54:55.750639 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:54:55.751816 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-3cf814d0-7d86-4364-8196-3a691facba1e tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Returning 404 to user: Instance b2c3871a-d117-4e6c-99c5-14777380ba38 could not be found. {{(pid=125871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:54:55.751816 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-3cf814d0-7d86-4364-8196-3a691facba1e tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] 10.222.0.16 "GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38" status: 404 len: 111 microversion: 2.1 time: 0.039339 Oct 17 03:54:55.751816 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 83/167] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:55 2022] GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 03:54:55.882916 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-32cc728f-44d1-40c4-892e-aff7eebc1122 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:55.885781 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-32cc728f-44d1-40c4-892e-aff7eebc1122 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] [instance: b2c3871a-d117-4e6c-99c5-14777380ba38] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:55.893396 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-32cc728f-44d1-40c4-892e-aff7eebc1122 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:55.893906 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-32cc728f-44d1-40c4-892e-aff7eebc1122 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:55.894338 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-32cc728f-44d1-40c4-892e-aff7eebc1122 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:55.895538 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-32cc728f-44d1-40c4-892e-aff7eebc1122 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:55.896039 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-32cc728f-44d1-40c4-892e-aff7eebc1122 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:55.897131 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-32cc728f-44d1-40c4-892e-aff7eebc1122 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:55.909384 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.wsgi [None req-32cc728f-44d1-40c4-892e-aff7eebc1122 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] HTTP exception thrown: Instance b2c3871a-d117-4e6c-99c5-14777380ba38 could not be found. Oct 17 03:54:55.913410 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-32cc728f-44d1-40c4-892e-aff7eebc1122 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Request method failure captured: Oct 17 03:54:55.913410 dv-cinder-815582-16-smb devstack@n-api.service[125872]: request: GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38/os-volume_attachments HTTP/1.1 Oct 17 03:54:55.913410 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Accept: application/json Oct 17 03:54:55.913410 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Accept-Encoding: identity Oct 17 03:54:55.913410 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Connection: close Oct 17 03:54:55.913410 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Content-Length: 0 Oct 17 03:54:55.913410 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Content-Type: application/json Oct 17 03:54:55.913410 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Host: 10.222.0.16 Oct 17 03:54:55.913410 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Openstack-System-Scope: None Oct 17 03:54:55.913410 dv-cinder-815582-16-smb devstack@n-api.service[125872]: User-Agent: python-urllib3/1.26.12 Oct 17 03:54:55.913410 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Auth-Token: gAAAAABjTNHY3r654DwvOrfgTnUdtTSXEBldPTUrUXvH_Gw_jPhVrCQiJv_SpROKm5Z2vvfHtCxcs5Ab-wl7nxwkmawCScCBE4kXAhM83nZGfDpyUPA19jFQAh-33Tqhe-ZPvhabYHE9IZlxiTBSXCskzaKVuvdJ35KCgR9GcXfgvv5anakCSEc Oct 17 03:54:55.913410 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Domain-Id: None Oct 17 03:54:55.913410 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Domain-Name: None Oct 17 03:54:55.913410 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Identity-Status: Confirmed Oct 17 03:54:55.913410 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Is-Admin-Project: True Oct 17 03:54:55.913410 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Domain-Id: default Oct 17 03:54:55.913410 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Domain-Name: Default Oct 17 03:54:55.913410 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Id: 1b4043f98c7544df8d2ad8152faf5299 Oct 17 03:54:55.913410 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Name: tempest-DeleteServersTestJSON-1098745372 Oct 17 03:54:55.913410 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Role: reader,member Oct 17 03:54:55.913410 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Roles: reader,member Oct 17 03:54:55.914704 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1b4043f98c7544df8d2ad8152faf5299"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1b4043f98c7544df8d2ad8152faf5299"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1b4043f98c7544df8d2ad8152faf5299"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1b4043f98c7544df8d2ad8152faf5299", "adminURL": "http://10.222.0.16:8080"}]}] Oct 17 03:54:55.914704 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant: tempest-DeleteServersTestJSON-1098745372 Oct 17 03:54:55.914704 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant-Id: 1b4043f98c7544df8d2ad8152faf5299 Oct 17 03:54:55.914704 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant-Name: tempest-DeleteServersTestJSON-1098745372 Oct 17 03:54:55.914704 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User: tempest-DeleteServersTestJSON-1098745372-project Oct 17 03:54:55.914704 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Domain-Id: default Oct 17 03:54:55.914704 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Domain-Name: Default Oct 17 03:54:55.914704 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Id: 6fc1a698f79642088bb13b3b40d25dc2 Oct 17 03:54:55.914704 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Name: tempest-DeleteServersTestJSON-1098745372-project Oct 17 03:54:55.914704 dv-cinder-815582-16-smb devstack@n-api.service[125872]: method: > Oct 17 03:54:55.914704 dv-cinder-815582-16-smb devstack@n-api.service[125872]: exception: Instance b2c3871a-d117-4e6c-99c5-14777380ba38 could not be found. Oct 17 03:54:55.914704 dv-cinder-815582-16-smb devstack@n-api.service[125872]: action_args: {'server_id': 'b2c3871a-d117-4e6c-99c5-14777380ba38'} Oct 17 03:54:55.915464 dv-cinder-815582-16-smb devstack@n-api.service[125872]: {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:54:55.915464 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:54:55.915464 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 03:54:55.915464 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 03:54:55.915464 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 03:54:55.915464 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 03:54:55.915464 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 03:54:55.915464 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 03:54:55.915464 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 03:54:55.915464 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 03:54:55.915464 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2c3871a-d117-4e6c-99c5-14777380ba38 could not be found. Oct 17 03:54:55.915464 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:54:55.915464 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:54:55.915464 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:54:55.915464 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:54:55.915464 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:54:55.915464 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:54:55.915464 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:54:55.915464 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:54:55.915464 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:54:55.916792 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:54:55.916792 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 03:54:55.916792 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 03:54:55.916792 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 03:54:55.916792 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 03:54:55.916792 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 17 03:54:55.916792 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 17 03:54:55.916792 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 03:54:55.916792 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:54:55.916792 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2c3871a-d117-4e6c-99c5-14777380ba38 could not be found. Oct 17 03:54:55.916792 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:54:55.916792 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:54:55.916792 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:54:55.916792 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:54:55.916792 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:54:55.916792 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:54:55.916792 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:54:55.916792 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:54:55.916792 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2c3871a-d117-4e6c-99c5-14777380ba38 could not be found. Oct 17 03:54:55.916792 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:54:55.918113 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-32cc728f-44d1-40c4-892e-aff7eebc1122 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Returning 404 to user: Instance b2c3871a-d117-4e6c-99c5-14777380ba38 could not be found. {{(pid=125872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:54:55.918113 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-32cc728f-44d1-40c4-892e-aff7eebc1122 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] 10.222.0.16 "GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035906 Oct 17 03:54:55.918113 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 85/168] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 17 03:54:55 2022] GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 03:54:55.947640 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-3e96065a-eaf3-4e06-8d86-df6a7366f328 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:55.954620 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-3e96065a-eaf3-4e06-8d86-df6a7366f328 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 15a2e41f-4480-429c-9207-8d95daa186f5] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:55.958775 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3e96065a-eaf3-4e06-8d86-df6a7366f328 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:55.959576 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3e96065a-eaf3-4e06-8d86-df6a7366f328 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:55.960205 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3e96065a-eaf3-4e06-8d86-df6a7366f328 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:55.961543 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3e96065a-eaf3-4e06-8d86-df6a7366f328 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:55.962309 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3e96065a-eaf3-4e06-8d86-df6a7366f328 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:55.962877 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3e96065a-eaf3-4e06-8d86-df6a7366f328 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:56.186720 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-3e96065a-eaf3-4e06-8d86-df6a7366f328 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:56.195318 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-3e96065a-eaf3-4e06-8d86-df6a7366f328 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5" status: 200 len: 1521 microversion: 2.1 time: 0.254465 Oct 17 03:54:56.195968 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 84/169] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:55 2022] GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5 => generated 1521 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:56.233601 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [req-9cad7b95-6a15-42b1-83c0-855cc9cdffa5 req-bbf12c00-9dcb-418e-90b2-81f93b20550e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bced6b7-8194-4fa1-90c6-94251db2b3a9", "tag": "607c008c-e2b0-45ad-b97f-cb1250da7e99"}]} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:54:56.252069 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-9cad7b95-6a15-42b1-83c0-855cc9cdffa5 req-bbf12c00-9dcb-418e-90b2-81f93b20550e service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:56.254242 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-9cad7b95-6a15-42b1-83c0-855cc9cdffa5 req-bbf12c00-9dcb-418e-90b2-81f93b20550e service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:56.254868 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-9cad7b95-6a15-42b1-83c0-855cc9cdffa5 req-bbf12c00-9dcb-418e-90b2-81f93b20550e service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:56.282049 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.compute.server_external_events [req-9cad7b95-6a15-42b1-83c0-855cc9cdffa5 req-bbf12c00-9dcb-418e-90b2-81f93b20550e service nova] Creating event network-changed:607c008c-e2b0-45ad-b97f-cb1250da7e99 for instance 5bced6b7-8194-4fa1-90c6-94251db2b3a9 on hv-cinder-81558 Oct 17 03:54:56.295361 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [req-9cad7b95-6a15-42b1-83c0-855cc9cdffa5 req-bbf12c00-9dcb-418e-90b2-81f93b20550e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065022 Oct 17 03:54:56.297296 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 86/170] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 03:54:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:54:56.531002 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-251c0874-e2b5-4f0a-a621-21921c1f249a tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:56.532008 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-251c0874-e2b5-4f0a-a621-21921c1f249a tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] [instance: 5bced6b7-8194-4fa1-90c6-94251db2b3a9] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:56.539009 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-251c0874-e2b5-4f0a-a621-21921c1f249a tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:56.539573 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-251c0874-e2b5-4f0a-a621-21921c1f249a tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:56.540013 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-251c0874-e2b5-4f0a-a621-21921c1f249a tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:56.540961 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-251c0874-e2b5-4f0a-a621-21921c1f249a tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:56.545859 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-251c0874-e2b5-4f0a-a621-21921c1f249a tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:56.546371 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-251c0874-e2b5-4f0a-a621-21921c1f249a tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:56.552399 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:54:56.968774 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-251c0874-e2b5-4f0a-a621-21921c1f249a tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445a5503db82419ebb96ac4518e37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1a41912e4cf45cf8409a238d3ed33bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:56.977728 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-251c0874-e2b5-4f0a-a621-21921c1f249a tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] 10.222.0.16 "GET /compute/v2.1/servers/5bced6b7-8194-4fa1-90c6-94251db2b3a9" status: 200 len: 1314 microversion: 2.1 time: 0.451326 Oct 17 03:54:56.980008 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 85/171] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:56 2022] GET /compute/v2.1/servers/5bced6b7-8194-4fa1-90c6-94251db2b3a9 => generated 1314 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:57.222179 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-1b54c68c-b47c-428f-a91f-384b54d80d49 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:57.223550 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-1b54c68c-b47c-428f-a91f-384b54d80d49 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 15a2e41f-4480-429c-9207-8d95daa186f5] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:57.230553 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1b54c68c-b47c-428f-a91f-384b54d80d49 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:57.231320 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1b54c68c-b47c-428f-a91f-384b54d80d49 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:57.231788 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1b54c68c-b47c-428f-a91f-384b54d80d49 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:57.233081 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1b54c68c-b47c-428f-a91f-384b54d80d49 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:57.233665 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1b54c68c-b47c-428f-a91f-384b54d80d49 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:57.234226 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1b54c68c-b47c-428f-a91f-384b54d80d49 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:57.366248 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-0849cce6-1d3f-411d-b3e6-1fcc3b442e22 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:57.367043 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-0849cce6-1d3f-411d-b3e6-1fcc3b442e22 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] [instance: b2c3871a-d117-4e6c-99c5-14777380ba38] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:57.375677 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0849cce6-1d3f-411d-b3e6-1fcc3b442e22 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:57.381117 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0849cce6-1d3f-411d-b3e6-1fcc3b442e22 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:57.381609 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0849cce6-1d3f-411d-b3e6-1fcc3b442e22 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:57.388504 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0849cce6-1d3f-411d-b3e6-1fcc3b442e22 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:57.389186 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0849cce6-1d3f-411d-b3e6-1fcc3b442e22 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:57.389770 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0849cce6-1d3f-411d-b3e6-1fcc3b442e22 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:57.415717 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.wsgi [None req-0849cce6-1d3f-411d-b3e6-1fcc3b442e22 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] HTTP exception thrown: Instance b2c3871a-d117-4e6c-99c5-14777380ba38 could not be found. Oct 17 03:54:57.416941 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-1b54c68c-b47c-428f-a91f-384b54d80d49 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:57.418733 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-0849cce6-1d3f-411d-b3e6-1fcc3b442e22 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Request method failure captured: Oct 17 03:54:57.418733 dv-cinder-815582-16-smb devstack@n-api.service[125871]: request: DELETE /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38 HTTP/1.1 Oct 17 03:54:57.418733 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Accept: application/json Oct 17 03:54:57.418733 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Accept-Encoding: identity Oct 17 03:54:57.418733 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Connection: close Oct 17 03:54:57.418733 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Content-Length: 0 Oct 17 03:54:57.418733 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Content-Type: application/json Oct 17 03:54:57.418733 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Host: 10.222.0.16 Oct 17 03:54:57.418733 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Openstack-System-Scope: None Oct 17 03:54:57.418733 dv-cinder-815582-16-smb devstack@n-api.service[125871]: User-Agent: python-urllib3/1.26.12 Oct 17 03:54:57.418733 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Auth-Token: gAAAAABjTNHY3r654DwvOrfgTnUdtTSXEBldPTUrUXvH_Gw_jPhVrCQiJv_SpROKm5Z2vvfHtCxcs5Ab-wl7nxwkmawCScCBE4kXAhM83nZGfDpyUPA19jFQAh-33Tqhe-ZPvhabYHE9IZlxiTBSXCskzaKVuvdJ35KCgR9GcXfgvv5anakCSEc Oct 17 03:54:57.418733 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Domain-Id: None Oct 17 03:54:57.418733 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Domain-Name: None Oct 17 03:54:57.418733 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Identity-Status: Confirmed Oct 17 03:54:57.418733 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Is-Admin-Project: True Oct 17 03:54:57.418733 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Domain-Id: default Oct 17 03:54:57.418733 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Domain-Name: Default Oct 17 03:54:57.418733 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Id: 1b4043f98c7544df8d2ad8152faf5299 Oct 17 03:54:57.418733 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Name: tempest-DeleteServersTestJSON-1098745372 Oct 17 03:54:57.418733 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Role: reader,member Oct 17 03:54:57.418733 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Roles: reader,member Oct 17 03:54:57.420636 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1b4043f98c7544df8d2ad8152faf5299"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1b4043f98c7544df8d2ad8152faf5299"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1b4043f98c7544df8d2ad8152faf5299"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1b4043f98c7544df8d2ad8152faf5299", "adminURL": "http://10.222.0.16:8080"}]}] Oct 17 03:54:57.420636 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant: tempest-DeleteServersTestJSON-1098745372 Oct 17 03:54:57.420636 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant-Id: 1b4043f98c7544df8d2ad8152faf5299 Oct 17 03:54:57.420636 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant-Name: tempest-DeleteServersTestJSON-1098745372 Oct 17 03:54:57.420636 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User: tempest-DeleteServersTestJSON-1098745372-project Oct 17 03:54:57.420636 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Domain-Id: default Oct 17 03:54:57.420636 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Domain-Name: Default Oct 17 03:54:57.420636 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Id: 6fc1a698f79642088bb13b3b40d25dc2 Oct 17 03:54:57.420636 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Name: tempest-DeleteServersTestJSON-1098745372-project Oct 17 03:54:57.420636 dv-cinder-815582-16-smb devstack@n-api.service[125871]: method: > Oct 17 03:54:57.420636 dv-cinder-815582-16-smb devstack@n-api.service[125871]: exception: Instance b2c3871a-d117-4e6c-99c5-14777380ba38 could not be found. Oct 17 03:54:57.420636 dv-cinder-815582-16-smb devstack@n-api.service[125871]: action_args: {'id': 'b2c3871a-d117-4e6c-99c5-14777380ba38'} Oct 17 03:54:57.421299 dv-cinder-815582-16-smb devstack@n-api.service[125871]: {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:54:57.421299 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:54:57.421299 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 03:54:57.421299 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 03:54:57.421299 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 03:54:57.421299 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 03:54:57.421299 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 03:54:57.421299 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 03:54:57.421299 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 03:54:57.421299 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 03:54:57.421299 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2c3871a-d117-4e6c-99c5-14777380ba38 could not be found. Oct 17 03:54:57.421299 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:54:57.421299 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:54:57.421299 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:54:57.421299 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:54:57.421299 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:54:57.421299 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:54:57.421299 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:54:57.421299 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:54:57.421299 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:54:57.422300 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:54:57.422300 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 03:54:57.422300 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 03:54:57.422300 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 03:54:57.422300 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 03:54:57.422300 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 03:54:57.422300 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 03:54:57.422300 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 03:54:57.422300 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:54:57.422300 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2c3871a-d117-4e6c-99c5-14777380ba38 could not be found. Oct 17 03:54:57.422300 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:54:57.422300 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:54:57.422300 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:54:57.422300 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:54:57.422300 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:54:57.422300 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:54:57.422300 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:54:57.422300 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:54:57.422300 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2c3871a-d117-4e6c-99c5-14777380ba38 could not be found. Oct 17 03:54:57.422300 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:54:57.435277 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-0849cce6-1d3f-411d-b3e6-1fcc3b442e22 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Returning 404 to user: Instance b2c3871a-d117-4e6c-99c5-14777380ba38 could not be found. {{(pid=125871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:54:57.435277 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-0849cce6-1d3f-411d-b3e6-1fcc3b442e22 tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38" status: 404 len: 111 microversion: 2.1 time: 0.061698 Oct 17 03:54:57.435277 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 86/172] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 17 03:54:57 2022] DELETE /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 03:54:57.435518 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-1b54c68c-b47c-428f-a91f-384b54d80d49 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5" status: 200 len: 1521 microversion: 2.1 time: 0.219203 Oct 17 03:54:57.438003 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 87/173] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:57 2022] GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5 => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:57.452783 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-a33771de-93b1-4d9a-8981-430d015886ed tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:57.453514 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-a33771de-93b1-4d9a-8981-430d015886ed tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] [instance: b2c3871a-d117-4e6c-99c5-14777380ba38] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:57.461015 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a33771de-93b1-4d9a-8981-430d015886ed tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:57.461514 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a33771de-93b1-4d9a-8981-430d015886ed tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:57.462220 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a33771de-93b1-4d9a-8981-430d015886ed tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:57.463092 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a33771de-93b1-4d9a-8981-430d015886ed tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:57.463579 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a33771de-93b1-4d9a-8981-430d015886ed tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:57.463973 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a33771de-93b1-4d9a-8981-430d015886ed tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:57.483102 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.wsgi [None req-a33771de-93b1-4d9a-8981-430d015886ed tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] HTTP exception thrown: Instance b2c3871a-d117-4e6c-99c5-14777380ba38 could not be found. Oct 17 03:54:57.484953 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-a33771de-93b1-4d9a-8981-430d015886ed tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Request method failure captured: Oct 17 03:54:57.484953 dv-cinder-815582-16-smb devstack@n-api.service[125871]: request: GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38 HTTP/1.1 Oct 17 03:54:57.484953 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Accept: application/json Oct 17 03:54:57.484953 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Accept-Encoding: identity Oct 17 03:54:57.484953 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Connection: close Oct 17 03:54:57.484953 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Content-Length: 0 Oct 17 03:54:57.484953 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Content-Type: application/json Oct 17 03:54:57.484953 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Host: 10.222.0.16 Oct 17 03:54:57.484953 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Openstack-System-Scope: None Oct 17 03:54:57.484953 dv-cinder-815582-16-smb devstack@n-api.service[125871]: User-Agent: python-urllib3/1.26.12 Oct 17 03:54:57.484953 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Auth-Token: gAAAAABjTNHY3r654DwvOrfgTnUdtTSXEBldPTUrUXvH_Gw_jPhVrCQiJv_SpROKm5Z2vvfHtCxcs5Ab-wl7nxwkmawCScCBE4kXAhM83nZGfDpyUPA19jFQAh-33Tqhe-ZPvhabYHE9IZlxiTBSXCskzaKVuvdJ35KCgR9GcXfgvv5anakCSEc Oct 17 03:54:57.484953 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Domain-Id: None Oct 17 03:54:57.484953 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Domain-Name: None Oct 17 03:54:57.484953 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Identity-Status: Confirmed Oct 17 03:54:57.484953 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Is-Admin-Project: True Oct 17 03:54:57.484953 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Domain-Id: default Oct 17 03:54:57.484953 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Domain-Name: Default Oct 17 03:54:57.484953 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Id: 1b4043f98c7544df8d2ad8152faf5299 Oct 17 03:54:57.484953 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Name: tempest-DeleteServersTestJSON-1098745372 Oct 17 03:54:57.484953 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Role: reader,member Oct 17 03:54:57.484953 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Roles: reader,member Oct 17 03:54:57.486106 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1b4043f98c7544df8d2ad8152faf5299"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1b4043f98c7544df8d2ad8152faf5299"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1b4043f98c7544df8d2ad8152faf5299"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1b4043f98c7544df8d2ad8152faf5299", "adminURL": "http://10.222.0.16:8080"}]}] Oct 17 03:54:57.486106 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant: tempest-DeleteServersTestJSON-1098745372 Oct 17 03:54:57.486106 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant-Id: 1b4043f98c7544df8d2ad8152faf5299 Oct 17 03:54:57.486106 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant-Name: tempest-DeleteServersTestJSON-1098745372 Oct 17 03:54:57.486106 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User: tempest-DeleteServersTestJSON-1098745372-project Oct 17 03:54:57.486106 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Domain-Id: default Oct 17 03:54:57.486106 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Domain-Name: Default Oct 17 03:54:57.486106 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Id: 6fc1a698f79642088bb13b3b40d25dc2 Oct 17 03:54:57.486106 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Name: tempest-DeleteServersTestJSON-1098745372-project Oct 17 03:54:57.486106 dv-cinder-815582-16-smb devstack@n-api.service[125871]: method: > Oct 17 03:54:57.486106 dv-cinder-815582-16-smb devstack@n-api.service[125871]: exception: Instance b2c3871a-d117-4e6c-99c5-14777380ba38 could not be found. Oct 17 03:54:57.486106 dv-cinder-815582-16-smb devstack@n-api.service[125871]: action_args: {'id': 'b2c3871a-d117-4e6c-99c5-14777380ba38'} Oct 17 03:54:57.486816 dv-cinder-815582-16-smb devstack@n-api.service[125871]: {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:54:57.486816 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:54:57.486816 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 03:54:57.486816 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 03:54:57.486816 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 03:54:57.486816 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 03:54:57.486816 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 03:54:57.486816 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 03:54:57.486816 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 03:54:57.486816 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 03:54:57.486816 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2c3871a-d117-4e6c-99c5-14777380ba38 could not be found. Oct 17 03:54:57.486816 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:54:57.486816 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:54:57.486816 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:54:57.486816 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:54:57.486816 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:54:57.486816 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:54:57.486816 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:54:57.486816 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:54:57.486816 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:54:57.488156 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:54:57.488156 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 03:54:57.488156 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 03:54:57.488156 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 03:54:57.488156 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 03:54:57.488156 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 03:54:57.488156 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:54:57.488156 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2c3871a-d117-4e6c-99c5-14777380ba38 could not be found. Oct 17 03:54:57.488156 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:54:57.488156 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:54:57.488156 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:54:57.488156 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:54:57.488156 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:54:57.488156 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:54:57.488156 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:54:57.488156 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:54:57.488156 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2c3871a-d117-4e6c-99c5-14777380ba38 could not be found. Oct 17 03:54:57.488156 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:54:57.489301 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-a33771de-93b1-4d9a-8981-430d015886ed tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] Returning 404 to user: Instance b2c3871a-d117-4e6c-99c5-14777380ba38 could not be found. {{(pid=125871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:54:57.489301 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-a33771de-93b1-4d9a-8981-430d015886ed tempest-DeleteServersTestJSON-1098745372 tempest-DeleteServersTestJSON-1098745372-project] 10.222.0.16 "GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38" status: 404 len: 111 microversion: 2.1 time: 0.059101 Oct 17 03:54:57.489301 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 87/174] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:57 2022] GET /compute/v2.1/servers/b2c3871a-d117-4e6c-99c5-14777380ba38 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 03:54:58.002492 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-2068e8ca-9d71-4248-a9aa-79d1bf5d2bbc tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:58.003215 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-2068e8ca-9d71-4248-a9aa-79d1bf5d2bbc tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] [instance: 5bced6b7-8194-4fa1-90c6-94251db2b3a9] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:58.009343 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2068e8ca-9d71-4248-a9aa-79d1bf5d2bbc tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:58.011706 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2068e8ca-9d71-4248-a9aa-79d1bf5d2bbc tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:58.011706 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2068e8ca-9d71-4248-a9aa-79d1bf5d2bbc tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:58.011706 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2068e8ca-9d71-4248-a9aa-79d1bf5d2bbc tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:58.011706 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2068e8ca-9d71-4248-a9aa-79d1bf5d2bbc tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:58.022994 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2068e8ca-9d71-4248-a9aa-79d1bf5d2bbc tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:58.267299 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-2068e8ca-9d71-4248-a9aa-79d1bf5d2bbc tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445a5503db82419ebb96ac4518e37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1a41912e4cf45cf8409a238d3ed33bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:58.278207 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-2068e8ca-9d71-4248-a9aa-79d1bf5d2bbc tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] 10.222.0.16 "GET /compute/v2.1/servers/5bced6b7-8194-4fa1-90c6-94251db2b3a9" status: 200 len: 1314 microversion: 2.1 time: 0.279983 Oct 17 03:54:58.287667 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 88/175] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:57 2022] GET /compute/v2.1/servers/5bced6b7-8194-4fa1-90c6-94251db2b3a9 => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:58.619763 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-81e287be-8e10-4725-a240-a0ff7fecaff1 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:58.619763 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-81e287be-8e10-4725-a240-a0ff7fecaff1 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 15a2e41f-4480-429c-9207-8d95daa186f5] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:58.619763 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-81e287be-8e10-4725-a240-a0ff7fecaff1 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:58.619763 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-81e287be-8e10-4725-a240-a0ff7fecaff1 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:58.622572 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-81e287be-8e10-4725-a240-a0ff7fecaff1 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:58.622572 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-81e287be-8e10-4725-a240-a0ff7fecaff1 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:58.622572 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-81e287be-8e10-4725-a240-a0ff7fecaff1 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:58.622572 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-81e287be-8e10-4725-a240-a0ff7fecaff1 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:58.623743 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-81e287be-8e10-4725-a240-a0ff7fecaff1 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:58.623743 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-81e287be-8e10-4725-a240-a0ff7fecaff1 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5" status: 200 len: 1521 microversion: 2.1 time: 0.150226 Oct 17 03:54:58.623743 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 88/176] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:58 2022] GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:59.310318 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-8972b7f8-fc5b-40c6-afe9-22d0f50721b3 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:59.310965 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-8972b7f8-fc5b-40c6-afe9-22d0f50721b3 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] [instance: 5bced6b7-8194-4fa1-90c6-94251db2b3a9] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:59.319664 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8972b7f8-fc5b-40c6-afe9-22d0f50721b3 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:59.320601 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8972b7f8-fc5b-40c6-afe9-22d0f50721b3 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:59.321261 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8972b7f8-fc5b-40c6-afe9-22d0f50721b3 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:59.322206 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8972b7f8-fc5b-40c6-afe9-22d0f50721b3 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:59.322881 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8972b7f8-fc5b-40c6-afe9-22d0f50721b3 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:59.323564 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8972b7f8-fc5b-40c6-afe9-22d0f50721b3 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:59.348441 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:54:59.613635 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-8972b7f8-fc5b-40c6-afe9-22d0f50721b3 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445a5503db82419ebb96ac4518e37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1a41912e4cf45cf8409a238d3ed33bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:54:59.636839 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-530dffd1-428a-4bad-8f30-1b9e5016f859 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:54:59.637423 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-530dffd1-428a-4bad-8f30-1b9e5016f859 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 15a2e41f-4480-429c-9207-8d95daa186f5] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:54:59.642778 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-8972b7f8-fc5b-40c6-afe9-22d0f50721b3 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] 10.222.0.16 "GET /compute/v2.1/servers/5bced6b7-8194-4fa1-90c6-94251db2b3a9" status: 200 len: 1314 microversion: 2.1 time: 0.336366 Oct 17 03:54:59.649226 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-530dffd1-428a-4bad-8f30-1b9e5016f859 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:59.650656 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-530dffd1-428a-4bad-8f30-1b9e5016f859 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:59.651902 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-530dffd1-428a-4bad-8f30-1b9e5016f859 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:59.653775 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-530dffd1-428a-4bad-8f30-1b9e5016f859 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:54:59.654331 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-530dffd1-428a-4bad-8f30-1b9e5016f859 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:54:59.654749 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-530dffd1-428a-4bad-8f30-1b9e5016f859 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:54:59.655243 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 89/177] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:59 2022] GET /compute/v2.1/servers/5bced6b7-8194-4fa1-90c6-94251db2b3a9 => generated 1314 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:54:59.909540 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-2cbc6fe5-d438-4644-b084-d9c166b06ad2 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-608873399", "imageRef": "add1979e-0a3b-4403-a8ae-8d9a7b045fc2", "flavorRef": "452"}} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:55:00.026122 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.network.neutron [None req-2cbc6fe5-d438-4644-b084-d9c166b06ad2 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] validate_networks() for None {{(pid=125872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 03:55:00.053288 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-530dffd1-428a-4bad-8f30-1b9e5016f859 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:00.062220 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-530dffd1-428a-4bad-8f30-1b9e5016f859 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5" status: 200 len: 1521 microversion: 2.1 time: 0.429890 Oct 17 03:55:00.063367 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 89/178] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:54:59 2022] GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5 => generated 1521 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:00.552535 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.virt.hardware [None req-2cbc6fe5-d438-4644-b084-d9c166b06ad2 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Flavor limits 0:0:0 {{(pid=125872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 03:55:00.554967 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.virt.hardware [None req-2cbc6fe5-d438-4644-b084-d9c166b06ad2 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Image limits 0:0:0 {{(pid=125872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 03:55:00.557671 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.virt.hardware [None req-2cbc6fe5-d438-4644-b084-d9c166b06ad2 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Flavor pref 0:0:0 {{(pid=125872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 03:55:00.558342 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.virt.hardware [None req-2cbc6fe5-d438-4644-b084-d9c166b06ad2 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Image pref 0:0:0 {{(pid=125872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 03:55:00.558967 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.virt.hardware [None req-2cbc6fe5-d438-4644-b084-d9c166b06ad2 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 03:55:00.575575 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2cbc6fe5-d438-4644-b084-d9c166b06ad2 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:00.577524 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2cbc6fe5-d438-4644-b084-d9c166b06ad2 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:00.578469 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2cbc6fe5-d438-4644-b084-d9c166b06ad2 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:00.580583 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2cbc6fe5-d438-4644-b084-d9c166b06ad2 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:00.582041 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2cbc6fe5-d438-4644-b084-d9c166b06ad2 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:00.582721 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2cbc6fe5-d438-4644-b084-d9c166b06ad2 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:00.624363 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.quota [None req-2cbc6fe5-d438-4644-b084-d9c166b06ad2 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Getting quotas for project 640a6e11de37477d9df98dc427bf810d. Resources: {'cores', 'instances', 'ram'} {{(pid=125872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 03:55:00.629199 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.quota [None req-2cbc6fe5-d438-4644-b084-d9c166b06ad2 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Getting quotas for user 27304fa6497b49e092b02173e5c516dc and project 640a6e11de37477d9df98dc427bf810d. Resources: {'cores', 'instances', 'ram'} {{(pid=125872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 03:55:00.644909 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-2cbc6fe5-d438-4644-b084-d9c166b06ad2 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Going to run 1 instances... {{(pid=125872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 03:55:00.650618 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-2cbc6fe5-d438-4644-b084-d9c166b06ad2 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] [instance: 146a05a0-dc55-4c0d-804b-0577d163cacb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='add1979e-0a3b-4403-a8ae-8d9a7b045fc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 03:55:00.670205 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-d553b2c1-b047-4994-aa57-9a7e75665a43 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:00.671750 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-d553b2c1-b047-4994-aa57-9a7e75665a43 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] [instance: 5bced6b7-8194-4fa1-90c6-94251db2b3a9] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:00.679815 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d553b2c1-b047-4994-aa57-9a7e75665a43 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:00.685982 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d553b2c1-b047-4994-aa57-9a7e75665a43 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:00.685982 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d553b2c1-b047-4994-aa57-9a7e75665a43 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:00.685982 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d553b2c1-b047-4994-aa57-9a7e75665a43 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:00.685982 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d553b2c1-b047-4994-aa57-9a7e75665a43 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:00.686399 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d553b2c1-b047-4994-aa57-9a7e75665a43 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:00.815093 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-2cbc6fe5-d438-4644-b084-d9c166b06ad2 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.915447 Oct 17 03:55:00.820713 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 90/179] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 17 03:54:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 922 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 03:55:00.840486 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-41efdb6b-16de-4756-ae10-6fda2f21da53 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:00.842869 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-41efdb6b-16de-4756-ae10-6fda2f21da53 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] [instance: 146a05a0-dc55-4c0d-804b-0577d163cacb] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:00.954996 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-d553b2c1-b047-4994-aa57-9a7e75665a43 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445a5503db82419ebb96ac4518e37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1a41912e4cf45cf8409a238d3ed33bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:00.961605 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-41efdb6b-16de-4756-ae10-6fda2f21da53 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27304fa6497b49e092b02173e5c516dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640a6e11de37477d9df98dc427bf810d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:00.970766 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-d553b2c1-b047-4994-aa57-9a7e75665a43 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] 10.222.0.16 "GET /compute/v2.1/servers/5bced6b7-8194-4fa1-90c6-94251db2b3a9" status: 200 len: 1314 microversion: 2.1 time: 0.303116 Oct 17 03:55:00.972355 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 90/180] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:00 2022] GET /compute/v2.1/servers/5bced6b7-8194-4fa1-90c6-94251db2b3a9 => generated 1314 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:55:00.973946 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-41efdb6b-16de-4756-ae10-6fda2f21da53 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] 10.222.0.16 "GET /compute/v2.1/servers/146a05a0-dc55-4c0d-804b-0577d163cacb" status: 200 len: 1214 microversion: 2.1 time: 0.141772 Oct 17 03:55:00.975977 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 91/181] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:00 2022] GET /compute/v2.1/servers/146a05a0-dc55-4c0d-804b-0577d163cacb => generated 1214 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:01.082360 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_cell0:SELECT=2 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:55:01.086825 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-a7ef29f7-c402-4586-ac9c-c2b19206c6b6 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:01.087824 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-a7ef29f7-c402-4586-ac9c-c2b19206c6b6 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 15a2e41f-4480-429c-9207-8d95daa186f5] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:01.101713 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a7ef29f7-c402-4586-ac9c-c2b19206c6b6 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:01.104604 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a7ef29f7-c402-4586-ac9c-c2b19206c6b6 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:01.112307 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a7ef29f7-c402-4586-ac9c-c2b19206c6b6 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:01.113329 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a7ef29f7-c402-4586-ac9c-c2b19206c6b6 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:01.114878 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a7ef29f7-c402-4586-ac9c-c2b19206c6b6 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:01.116526 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a7ef29f7-c402-4586-ac9c-c2b19206c6b6 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:01.347388 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-a7ef29f7-c402-4586-ac9c-c2b19206c6b6 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:01.355240 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-a7ef29f7-c402-4586-ac9c-c2b19206c6b6 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5" status: 200 len: 1521 microversion: 2.1 time: 0.273585 Oct 17 03:55:01.355813 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 91/182] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:01 2022] GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5 => generated 1521 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:02.003869 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-eb7a8ad2-1f3e-4786-a9ec-b6c993b2a6be tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:02.005324 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-50542adb-733c-4e15-aea7-2660d8672373 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:02.006470 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-eb7a8ad2-1f3e-4786-a9ec-b6c993b2a6be tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] [instance: 146a05a0-dc55-4c0d-804b-0577d163cacb] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:02.007339 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-50542adb-733c-4e15-aea7-2660d8672373 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] [instance: 5bced6b7-8194-4fa1-90c6-94251db2b3a9] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:02.027581 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-50542adb-733c-4e15-aea7-2660d8672373 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:02.037268 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-50542adb-733c-4e15-aea7-2660d8672373 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:02.041926 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-50542adb-733c-4e15-aea7-2660d8672373 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:02.041926 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-50542adb-733c-4e15-aea7-2660d8672373 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:02.041926 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-50542adb-733c-4e15-aea7-2660d8672373 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:02.041926 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-50542adb-733c-4e15-aea7-2660d8672373 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:02.110679 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-eb7a8ad2-1f3e-4786-a9ec-b6c993b2a6be tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27304fa6497b49e092b02173e5c516dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640a6e11de37477d9df98dc427bf810d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:02.119329 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-eb7a8ad2-1f3e-4786-a9ec-b6c993b2a6be tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] 10.222.0.16 "GET /compute/v2.1/servers/146a05a0-dc55-4c0d-804b-0577d163cacb" status: 200 len: 1214 microversion: 2.1 time: 0.122028 Oct 17 03:55:02.122088 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 92/183] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:01 2022] GET /compute/v2.1/servers/146a05a0-dc55-4c0d-804b-0577d163cacb => generated 1214 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:55:02.312001 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-50542adb-733c-4e15-aea7-2660d8672373 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445a5503db82419ebb96ac4518e37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1a41912e4cf45cf8409a238d3ed33bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:02.323090 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-50542adb-733c-4e15-aea7-2660d8672373 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] 10.222.0.16 "GET /compute/v2.1/servers/5bced6b7-8194-4fa1-90c6-94251db2b3a9" status: 200 len: 1314 microversion: 2.1 time: 0.331238 Oct 17 03:55:02.339460 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 92/184] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:01 2022] GET /compute/v2.1/servers/5bced6b7-8194-4fa1-90c6-94251db2b3a9 => generated 1314 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:02.378909 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-80a6a108-d14a-4b95-b014-d95025c011ff tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:02.379550 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-80a6a108-d14a-4b95-b014-d95025c011ff tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 15a2e41f-4480-429c-9207-8d95daa186f5] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:02.392337 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-80a6a108-d14a-4b95-b014-d95025c011ff tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:02.393032 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-80a6a108-d14a-4b95-b014-d95025c011ff tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:02.398239 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-80a6a108-d14a-4b95-b014-d95025c011ff tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:02.400350 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-80a6a108-d14a-4b95-b014-d95025c011ff tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:02.401372 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-80a6a108-d14a-4b95-b014-d95025c011ff tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:02.402281 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-80a6a108-d14a-4b95-b014-d95025c011ff tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:02.565952 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-80a6a108-d14a-4b95-b014-d95025c011ff tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:02.574272 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-80a6a108-d14a-4b95-b014-d95025c011ff tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5" status: 200 len: 1521 microversion: 2.1 time: 0.199303 Oct 17 03:55:02.574859 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 93/185] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:02 2022] GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5 => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:55:02.581432 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [req-687a20d7-a3f5-4094-8419-cdb3ca4a25a8 req-1ba0da23-6d17-4dff-afe8-7582985d8836 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bced6b7-8194-4fa1-90c6-94251db2b3a9", "name": "network-vif-plugged", "status": "completed", "tag": "607c008c-e2b0-45ad-b97f-cb1250da7e99"}]} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:55:02.608972 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-687a20d7-a3f5-4094-8419-cdb3ca4a25a8 req-1ba0da23-6d17-4dff-afe8-7582985d8836 service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:02.610533 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-687a20d7-a3f5-4094-8419-cdb3ca4a25a8 req-1ba0da23-6d17-4dff-afe8-7582985d8836 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:02.612247 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-687a20d7-a3f5-4094-8419-cdb3ca4a25a8 req-1ba0da23-6d17-4dff-afe8-7582985d8836 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:02.627645 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.compute.server_external_events [req-687a20d7-a3f5-4094-8419-cdb3ca4a25a8 req-1ba0da23-6d17-4dff-afe8-7582985d8836 service nova] Creating event network-vif-plugged:607c008c-e2b0-45ad-b97f-cb1250da7e99 for instance 5bced6b7-8194-4fa1-90c6-94251db2b3a9 on hv-cinder-81558 Oct 17 03:55:02.632401 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [req-687a20d7-a3f5-4094-8419-cdb3ca4a25a8 req-1ba0da23-6d17-4dff-afe8-7582985d8836 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054835 Oct 17 03:55:02.633034 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 93/186] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 03:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 03:55:03.146012 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-4ee65328-fba3-496e-9cc7-59436843cf19 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:03.151324 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-4ee65328-fba3-496e-9cc7-59436843cf19 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] [instance: 146a05a0-dc55-4c0d-804b-0577d163cacb] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:03.163701 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-4ee65328-fba3-496e-9cc7-59436843cf19 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:03.167387 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-4ee65328-fba3-496e-9cc7-59436843cf19 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:03.173801 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-4ee65328-fba3-496e-9cc7-59436843cf19 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:03.179495 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-4ee65328-fba3-496e-9cc7-59436843cf19 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:03.179495 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-4ee65328-fba3-496e-9cc7-59436843cf19 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:03.179495 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-4ee65328-fba3-496e-9cc7-59436843cf19 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:03.278150 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-4ee65328-fba3-496e-9cc7-59436843cf19 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27304fa6497b49e092b02173e5c516dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640a6e11de37477d9df98dc427bf810d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:03.291566 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-4ee65328-fba3-496e-9cc7-59436843cf19 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] 10.222.0.16 "GET /compute/v2.1/servers/146a05a0-dc55-4c0d-804b-0577d163cacb" status: 200 len: 1266 microversion: 2.1 time: 0.148479 Oct 17 03:55:03.295662 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 94/187] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:03 2022] GET /compute/v2.1/servers/146a05a0-dc55-4c0d-804b-0577d163cacb => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:03.348194 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-96ce5bb8-0a2d-411d-937e-b84c9c301b7f tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:03.348974 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-96ce5bb8-0a2d-411d-937e-b84c9c301b7f tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] [instance: 5bced6b7-8194-4fa1-90c6-94251db2b3a9] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:03.356331 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-96ce5bb8-0a2d-411d-937e-b84c9c301b7f tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:03.361102 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-96ce5bb8-0a2d-411d-937e-b84c9c301b7f tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:03.361102 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-96ce5bb8-0a2d-411d-937e-b84c9c301b7f tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:03.361102 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-96ce5bb8-0a2d-411d-937e-b84c9c301b7f tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:03.361102 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-96ce5bb8-0a2d-411d-937e-b84c9c301b7f tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:03.362215 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-96ce5bb8-0a2d-411d-937e-b84c9c301b7f tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:03.553627 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-96ce5bb8-0a2d-411d-937e-b84c9c301b7f tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445a5503db82419ebb96ac4518e37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1a41912e4cf45cf8409a238d3ed33bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:03.563653 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-96ce5bb8-0a2d-411d-937e-b84c9c301b7f tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] 10.222.0.16 "GET /compute/v2.1/servers/5bced6b7-8194-4fa1-90c6-94251db2b3a9" status: 200 len: 1314 microversion: 2.1 time: 0.220778 Oct 17 03:55:03.564232 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 94/188] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:03 2022] GET /compute/v2.1/servers/5bced6b7-8194-4fa1-90c6-94251db2b3a9 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:03.598526 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-b7b357e6-a8a3-47e4-81f1-43dac3853230 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:03.599213 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-b7b357e6-a8a3-47e4-81f1-43dac3853230 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 15a2e41f-4480-429c-9207-8d95daa186f5] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:03.605342 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b7b357e6-a8a3-47e4-81f1-43dac3853230 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:03.605861 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b7b357e6-a8a3-47e4-81f1-43dac3853230 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:03.606294 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b7b357e6-a8a3-47e4-81f1-43dac3853230 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:03.607016 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b7b357e6-a8a3-47e4-81f1-43dac3853230 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:03.607492 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b7b357e6-a8a3-47e4-81f1-43dac3853230 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:03.607915 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b7b357e6-a8a3-47e4-81f1-43dac3853230 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:03.798287 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-b7b357e6-a8a3-47e4-81f1-43dac3853230 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:03.810247 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-b7b357e6-a8a3-47e4-81f1-43dac3853230 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5" status: 200 len: 1521 microversion: 2.1 time: 0.215520 Oct 17 03:55:03.811531 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 95/189] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:03 2022] GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5 => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:55:04.318066 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-2b248fcf-9397-49be-af41-eaf3c102821b tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:04.318683 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-2b248fcf-9397-49be-af41-eaf3c102821b tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] [instance: 146a05a0-dc55-4c0d-804b-0577d163cacb] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:04.325677 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2b248fcf-9397-49be-af41-eaf3c102821b tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:04.326164 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2b248fcf-9397-49be-af41-eaf3c102821b tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:04.326595 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2b248fcf-9397-49be-af41-eaf3c102821b tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:04.327393 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2b248fcf-9397-49be-af41-eaf3c102821b tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:04.328000 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2b248fcf-9397-49be-af41-eaf3c102821b tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:04.328572 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2b248fcf-9397-49be-af41-eaf3c102821b tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:04.441043 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-2b248fcf-9397-49be-af41-eaf3c102821b tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27304fa6497b49e092b02173e5c516dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640a6e11de37477d9df98dc427bf810d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:04.453923 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-2b248fcf-9397-49be-af41-eaf3c102821b tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] 10.222.0.16 "GET /compute/v2.1/servers/146a05a0-dc55-4c0d-804b-0577d163cacb" status: 200 len: 1266 microversion: 2.1 time: 0.139582 Oct 17 03:55:04.454796 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 95/190] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:04 2022] GET /compute/v2.1/servers/146a05a0-dc55-4c0d-804b-0577d163cacb => generated 1266 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:04.587046 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-97ffdeae-b0f7-43ef-8049-83c19a606dc3 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:04.587693 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-97ffdeae-b0f7-43ef-8049-83c19a606dc3 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] [instance: 5bced6b7-8194-4fa1-90c6-94251db2b3a9] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:04.594416 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-97ffdeae-b0f7-43ef-8049-83c19a606dc3 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:04.594905 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-97ffdeae-b0f7-43ef-8049-83c19a606dc3 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:04.595366 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-97ffdeae-b0f7-43ef-8049-83c19a606dc3 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:04.596220 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-97ffdeae-b0f7-43ef-8049-83c19a606dc3 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:04.596673 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-97ffdeae-b0f7-43ef-8049-83c19a606dc3 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:04.597094 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-97ffdeae-b0f7-43ef-8049-83c19a606dc3 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:04.751925 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-97ffdeae-b0f7-43ef-8049-83c19a606dc3 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445a5503db82419ebb96ac4518e37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1a41912e4cf45cf8409a238d3ed33bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:04.760002 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-97ffdeae-b0f7-43ef-8049-83c19a606dc3 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] 10.222.0.16 "GET /compute/v2.1/servers/5bced6b7-8194-4fa1-90c6-94251db2b3a9" status: 200 len: 1497 microversion: 2.1 time: 0.177615 Oct 17 03:55:04.764987 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 96/191] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:04 2022] GET /compute/v2.1/servers/5bced6b7-8194-4fa1-90c6-94251db2b3a9 => generated 1497 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:04.836454 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-cd0268e6-d55e-4da8-bfe2-93b09aa643d1 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:04.837075 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-cd0268e6-d55e-4da8-bfe2-93b09aa643d1 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 15a2e41f-4480-429c-9207-8d95daa186f5] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:04.844331 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-cd0268e6-d55e-4da8-bfe2-93b09aa643d1 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:04.844936 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-cd0268e6-d55e-4da8-bfe2-93b09aa643d1 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:04.845428 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-cd0268e6-d55e-4da8-bfe2-93b09aa643d1 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:04.846128 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-cd0268e6-d55e-4da8-bfe2-93b09aa643d1 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:04.846583 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-cd0268e6-d55e-4da8-bfe2-93b09aa643d1 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:04.847008 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-cd0268e6-d55e-4da8-bfe2-93b09aa643d1 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:05.004459 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-cd0268e6-d55e-4da8-bfe2-93b09aa643d1 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:05.012687 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-cd0268e6-d55e-4da8-bfe2-93b09aa643d1 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5" status: 200 len: 1521 microversion: 2.1 time: 0.180139 Oct 17 03:55:05.014103 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 96/192] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:04 2022] GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:05.477285 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-361d8e62-d0e7-4200-a3dd-bd942f06c2e0 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:05.478013 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-361d8e62-d0e7-4200-a3dd-bd942f06c2e0 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] [instance: 146a05a0-dc55-4c0d-804b-0577d163cacb] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:05.484071 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-361d8e62-d0e7-4200-a3dd-bd942f06c2e0 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:05.485009 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-361d8e62-d0e7-4200-a3dd-bd942f06c2e0 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:05.485561 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-361d8e62-d0e7-4200-a3dd-bd942f06c2e0 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:05.486479 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-361d8e62-d0e7-4200-a3dd-bd942f06c2e0 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:05.487145 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-361d8e62-d0e7-4200-a3dd-bd942f06c2e0 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:05.488274 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-361d8e62-d0e7-4200-a3dd-bd942f06c2e0 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:05.588151 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-361d8e62-d0e7-4200-a3dd-bd942f06c2e0 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27304fa6497b49e092b02173e5c516dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640a6e11de37477d9df98dc427bf810d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:05.596195 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-361d8e62-d0e7-4200-a3dd-bd942f06c2e0 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] 10.222.0.16 "GET /compute/v2.1/servers/146a05a0-dc55-4c0d-804b-0577d163cacb" status: 200 len: 1272 microversion: 2.1 time: 0.122732 Oct 17 03:55:05.596829 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 97/193] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:05 2022] GET /compute/v2.1/servers/146a05a0-dc55-4c0d-804b-0577d163cacb => generated 1272 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:06.050207 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-b44f6d1a-654b-4792-a0be-ff5999996e19 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:06.050207 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-b44f6d1a-654b-4792-a0be-ff5999996e19 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 15a2e41f-4480-429c-9207-8d95daa186f5] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:06.056575 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b44f6d1a-654b-4792-a0be-ff5999996e19 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:06.057437 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b44f6d1a-654b-4792-a0be-ff5999996e19 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:06.057944 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b44f6d1a-654b-4792-a0be-ff5999996e19 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:06.058801 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b44f6d1a-654b-4792-a0be-ff5999996e19 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:06.059431 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b44f6d1a-654b-4792-a0be-ff5999996e19 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:06.060672 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b44f6d1a-654b-4792-a0be-ff5999996e19 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:06.225072 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-b44f6d1a-654b-4792-a0be-ff5999996e19 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:06.233900 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-b44f6d1a-654b-4792-a0be-ff5999996e19 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5" status: 200 len: 1521 microversion: 2.1 time: 0.196501 Oct 17 03:55:06.234569 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 97/194] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:06 2022] GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:06.620817 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-c5427fad-3154-474e-a541-09ff25e8e5a9 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:06.626085 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-c5427fad-3154-474e-a541-09ff25e8e5a9 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] [instance: 146a05a0-dc55-4c0d-804b-0577d163cacb] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:06.627966 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c5427fad-3154-474e-a541-09ff25e8e5a9 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:06.628483 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c5427fad-3154-474e-a541-09ff25e8e5a9 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:06.628915 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c5427fad-3154-474e-a541-09ff25e8e5a9 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:06.629619 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c5427fad-3154-474e-a541-09ff25e8e5a9 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:06.630070 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c5427fad-3154-474e-a541-09ff25e8e5a9 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:06.630492 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c5427fad-3154-474e-a541-09ff25e8e5a9 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:06.856829 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-c5427fad-3154-474e-a541-09ff25e8e5a9 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27304fa6497b49e092b02173e5c516dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640a6e11de37477d9df98dc427bf810d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:06.865714 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-c5427fad-3154-474e-a541-09ff25e8e5a9 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] 10.222.0.16 "GET /compute/v2.1/servers/146a05a0-dc55-4c0d-804b-0577d163cacb" status: 200 len: 1314 microversion: 2.1 time: 0.249642 Oct 17 03:55:06.866294 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 98/195] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:06 2022] GET /compute/v2.1/servers/146a05a0-dc55-4c0d-804b-0577d163cacb => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:07.258212 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-77782e66-8615-4cc9-843c-a4318791bf70 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:07.258829 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-77782e66-8615-4cc9-843c-a4318791bf70 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 15a2e41f-4480-429c-9207-8d95daa186f5] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:07.266811 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-77782e66-8615-4cc9-843c-a4318791bf70 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:07.267137 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-77782e66-8615-4cc9-843c-a4318791bf70 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:07.267606 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-77782e66-8615-4cc9-843c-a4318791bf70 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:07.268299 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-77782e66-8615-4cc9-843c-a4318791bf70 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:07.268745 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-77782e66-8615-4cc9-843c-a4318791bf70 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:07.269234 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-77782e66-8615-4cc9-843c-a4318791bf70 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:07.576681 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-77782e66-8615-4cc9-843c-a4318791bf70 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:07.584790 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-77782e66-8615-4cc9-843c-a4318791bf70 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5" status: 200 len: 1521 microversion: 2.1 time: 0.331472 Oct 17 03:55:07.585698 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 98/196] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:07 2022] GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5 => generated 1521 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:07.641661 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [req-e22c9de0-9ee1-4b19-bd68-1a748e6327cd req-862972cc-1386-4296-a649-d07de9eb0b60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "146a05a0-dc55-4c0d-804b-0577d163cacb", "tag": "e6421995-619e-49f1-ad17-02977a0ac23e"}]} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:55:07.651682 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-e22c9de0-9ee1-4b19-bd68-1a748e6327cd req-862972cc-1386-4296-a649-d07de9eb0b60 service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:07.652509 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-e22c9de0-9ee1-4b19-bd68-1a748e6327cd req-862972cc-1386-4296-a649-d07de9eb0b60 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:07.653084 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-e22c9de0-9ee1-4b19-bd68-1a748e6327cd req-862972cc-1386-4296-a649-d07de9eb0b60 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:07.665625 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.compute.server_external_events [req-e22c9de0-9ee1-4b19-bd68-1a748e6327cd req-862972cc-1386-4296-a649-d07de9eb0b60 service nova] Creating event network-changed:e6421995-619e-49f1-ad17-02977a0ac23e for instance 146a05a0-dc55-4c0d-804b-0577d163cacb on hv-cinder-81558 Oct 17 03:55:07.677238 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [req-e22c9de0-9ee1-4b19-bd68-1a748e6327cd req-862972cc-1386-4296-a649-d07de9eb0b60 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039815 Oct 17 03:55:07.678975 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 99/197] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 03:55:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:55:07.890299 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-e4f0c1e7-62fa-4b39-bdf7-19a964915d55 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:07.891164 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-e4f0c1e7-62fa-4b39-bdf7-19a964915d55 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] [instance: 146a05a0-dc55-4c0d-804b-0577d163cacb] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:07.898117 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e4f0c1e7-62fa-4b39-bdf7-19a964915d55 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:07.898791 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e4f0c1e7-62fa-4b39-bdf7-19a964915d55 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:07.899415 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e4f0c1e7-62fa-4b39-bdf7-19a964915d55 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:07.901273 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e4f0c1e7-62fa-4b39-bdf7-19a964915d55 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:07.902221 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e4f0c1e7-62fa-4b39-bdf7-19a964915d55 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:07.902794 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e4f0c1e7-62fa-4b39-bdf7-19a964915d55 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:08.141204 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-e4f0c1e7-62fa-4b39-bdf7-19a964915d55 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27304fa6497b49e092b02173e5c516dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640a6e11de37477d9df98dc427bf810d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:08.150842 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-e4f0c1e7-62fa-4b39-bdf7-19a964915d55 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] 10.222.0.16 "GET /compute/v2.1/servers/146a05a0-dc55-4c0d-804b-0577d163cacb" status: 200 len: 1314 microversion: 2.1 time: 0.265390 Oct 17 03:55:08.151456 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 99/198] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:07 2022] GET /compute/v2.1/servers/146a05a0-dc55-4c0d-804b-0577d163cacb => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:08.610118 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-8a5b1bb3-771b-47a7-803d-0388709b8c22 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:08.611580 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-8a5b1bb3-771b-47a7-803d-0388709b8c22 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 15a2e41f-4480-429c-9207-8d95daa186f5] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:08.620817 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8a5b1bb3-771b-47a7-803d-0388709b8c22 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:08.621634 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8a5b1bb3-771b-47a7-803d-0388709b8c22 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:08.622373 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8a5b1bb3-771b-47a7-803d-0388709b8c22 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:08.623342 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8a5b1bb3-771b-47a7-803d-0388709b8c22 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:08.623960 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8a5b1bb3-771b-47a7-803d-0388709b8c22 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:08.624399 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8a5b1bb3-771b-47a7-803d-0388709b8c22 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:08.821109 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-059935b5-5718-42cf-a1a3-c8b9ed684cf4 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:08.822195 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-059935b5-5718-42cf-a1a3-c8b9ed684cf4 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] [instance: 5bced6b7-8194-4fa1-90c6-94251db2b3a9] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:08.833102 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-059935b5-5718-42cf-a1a3-c8b9ed684cf4 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:08.834588 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-059935b5-5718-42cf-a1a3-c8b9ed684cf4 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:08.835216 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-059935b5-5718-42cf-a1a3-c8b9ed684cf4 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:08.837074 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-059935b5-5718-42cf-a1a3-c8b9ed684cf4 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:08.837074 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-059935b5-5718-42cf-a1a3-c8b9ed684cf4 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:08.837425 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-059935b5-5718-42cf-a1a3-c8b9ed684cf4 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:08.867070 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-8a5b1bb3-771b-47a7-803d-0388709b8c22 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:08.875483 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-8a5b1bb3-771b-47a7-803d-0388709b8c22 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5" status: 200 len: 1521 microversion: 2.1 time: 0.270135 Oct 17 03:55:08.876360 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 100/199] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:08 2022] GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5 => generated 1521 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:08.887005 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-059935b5-5718-42cf-a1a3-c8b9ed684cf4 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] [instance: 5bced6b7-8194-4fa1-90c6-94251db2b3a9] Going to try to terminate instance {{(pid=125872) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 03:55:09.173055 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-a1d59932-12a1-40ee-9786-8b4d7be84ebe tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:09.173682 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-a1d59932-12a1-40ee-9786-8b4d7be84ebe tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] [instance: 146a05a0-dc55-4c0d-804b-0577d163cacb] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:09.180331 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a1d59932-12a1-40ee-9786-8b4d7be84ebe tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:09.181362 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a1d59932-12a1-40ee-9786-8b4d7be84ebe tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:09.182018 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a1d59932-12a1-40ee-9786-8b4d7be84ebe tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:09.183236 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a1d59932-12a1-40ee-9786-8b4d7be84ebe tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:09.183907 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a1d59932-12a1-40ee-9786-8b4d7be84ebe tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:09.184555 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a1d59932-12a1-40ee-9786-8b4d7be84ebe tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:09.275564 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-059935b5-5718-42cf-a1a3-c8b9ed684cf4 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5bced6b7-8194-4fa1-90c6-94251db2b3a9" status: 204 len: 0 microversion: 2.1 time: 0.459443 Oct 17 03:55:09.276155 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 100/200] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 17 03:55:08 2022] DELETE /compute/v2.1/servers/5bced6b7-8194-4fa1-90c6-94251db2b3a9 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 03:55:09.285466 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-a412f2e2-96e4-483c-8ec5-a268a40eee7f tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:09.286169 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-a412f2e2-96e4-483c-8ec5-a268a40eee7f tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] [instance: 5bced6b7-8194-4fa1-90c6-94251db2b3a9] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:09.292511 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a412f2e2-96e4-483c-8ec5-a268a40eee7f tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:09.293032 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a412f2e2-96e4-483c-8ec5-a268a40eee7f tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:09.293688 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a412f2e2-96e4-483c-8ec5-a268a40eee7f tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:09.294419 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a412f2e2-96e4-483c-8ec5-a268a40eee7f tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:09.294868 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a412f2e2-96e4-483c-8ec5-a268a40eee7f tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:09.295308 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a412f2e2-96e4-483c-8ec5-a268a40eee7f tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:09.344478 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-a1d59932-12a1-40ee-9786-8b4d7be84ebe tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27304fa6497b49e092b02173e5c516dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640a6e11de37477d9df98dc427bf810d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:09.353080 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-a1d59932-12a1-40ee-9786-8b4d7be84ebe tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] 10.222.0.16 "GET /compute/v2.1/servers/146a05a0-dc55-4c0d-804b-0577d163cacb" status: 200 len: 1314 microversion: 2.1 time: 0.183949 Oct 17 03:55:09.353679 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 101/201] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:09 2022] GET /compute/v2.1/servers/146a05a0-dc55-4c0d-804b-0577d163cacb => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:55:09.525174 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-a412f2e2-96e4-483c-8ec5-a268a40eee7f tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445a5503db82419ebb96ac4518e37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1a41912e4cf45cf8409a238d3ed33bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:09.539257 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-a412f2e2-96e4-483c-8ec5-a268a40eee7f tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] 10.222.0.16 "GET /compute/v2.1/servers/5bced6b7-8194-4fa1-90c6-94251db2b3a9" status: 200 len: 1503 microversion: 2.1 time: 0.258325 Oct 17 03:55:09.539838 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 101/202] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:09 2022] GET /compute/v2.1/servers/5bced6b7-8194-4fa1-90c6-94251db2b3a9 => generated 1503 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:55:09.902132 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-f1934e3b-448b-44db-828a-6cc028e6ea0e tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:09.902754 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-f1934e3b-448b-44db-828a-6cc028e6ea0e tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 15a2e41f-4480-429c-9207-8d95daa186f5] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:09.910384 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f1934e3b-448b-44db-828a-6cc028e6ea0e tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:09.910873 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f1934e3b-448b-44db-828a-6cc028e6ea0e tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:09.911325 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f1934e3b-448b-44db-828a-6cc028e6ea0e tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:09.912276 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f1934e3b-448b-44db-828a-6cc028e6ea0e tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:09.912933 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f1934e3b-448b-44db-828a-6cc028e6ea0e tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:09.913561 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f1934e3b-448b-44db-828a-6cc028e6ea0e tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:10.129825 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-f1934e3b-448b-44db-828a-6cc028e6ea0e tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:10.144846 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-f1934e3b-448b-44db-828a-6cc028e6ea0e tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5" status: 200 len: 1521 microversion: 2.1 time: 0.246189 Oct 17 03:55:10.146417 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 102/203] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:09 2022] GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5 => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:10.376129 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-a1e3dddb-6140-43f6-a22f-057cb7d82e9c tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:10.377498 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-a1e3dddb-6140-43f6-a22f-057cb7d82e9c tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] [instance: 146a05a0-dc55-4c0d-804b-0577d163cacb] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:10.384601 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a1e3dddb-6140-43f6-a22f-057cb7d82e9c tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:10.385638 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a1e3dddb-6140-43f6-a22f-057cb7d82e9c tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:10.386701 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a1e3dddb-6140-43f6-a22f-057cb7d82e9c tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:10.387567 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a1e3dddb-6140-43f6-a22f-057cb7d82e9c tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:10.391650 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a1e3dddb-6140-43f6-a22f-057cb7d82e9c tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:10.393019 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a1e3dddb-6140-43f6-a22f-057cb7d82e9c tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:10.557560 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-a1e3dddb-6140-43f6-a22f-057cb7d82e9c tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27304fa6497b49e092b02173e5c516dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640a6e11de37477d9df98dc427bf810d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:10.563038 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-3aab9f53-cae2-4002-bfc7-1ce52c12629e tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:10.563697 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-3aab9f53-cae2-4002-bfc7-1ce52c12629e tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] [instance: 5bced6b7-8194-4fa1-90c6-94251db2b3a9] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:10.565707 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-a1e3dddb-6140-43f6-a22f-057cb7d82e9c tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] 10.222.0.16 "GET /compute/v2.1/servers/146a05a0-dc55-4c0d-804b-0577d163cacb" status: 200 len: 1314 microversion: 2.1 time: 0.193477 Oct 17 03:55:10.566359 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 102/204] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:10 2022] GET /compute/v2.1/servers/146a05a0-dc55-4c0d-804b-0577d163cacb => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:10.570151 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3aab9f53-cae2-4002-bfc7-1ce52c12629e tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:10.570690 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3aab9f53-cae2-4002-bfc7-1ce52c12629e tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:10.571131 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3aab9f53-cae2-4002-bfc7-1ce52c12629e tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:10.571856 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3aab9f53-cae2-4002-bfc7-1ce52c12629e tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:10.572315 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3aab9f53-cae2-4002-bfc7-1ce52c12629e tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:10.572743 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3aab9f53-cae2-4002-bfc7-1ce52c12629e tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:10.852245 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-3aab9f53-cae2-4002-bfc7-1ce52c12629e tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445a5503db82419ebb96ac4518e37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1a41912e4cf45cf8409a238d3ed33bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:10.863074 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-3aab9f53-cae2-4002-bfc7-1ce52c12629e tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] 10.222.0.16 "GET /compute/v2.1/servers/5bced6b7-8194-4fa1-90c6-94251db2b3a9" status: 200 len: 1503 microversion: 2.1 time: 0.303738 Oct 17 03:55:10.863874 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 103/205] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:10 2022] GET /compute/v2.1/servers/5bced6b7-8194-4fa1-90c6-94251db2b3a9 => generated 1503 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:11.170843 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-df310255-0671-4a5e-8146-1ed39fa3a077 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:11.171504 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-df310255-0671-4a5e-8146-1ed39fa3a077 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 15a2e41f-4480-429c-9207-8d95daa186f5] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:11.173622 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_cell0:SELECT=4 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:55:11.174522 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_cell0:SELECT=16 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:55:11.179908 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-df310255-0671-4a5e-8146-1ed39fa3a077 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:11.180718 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-df310255-0671-4a5e-8146-1ed39fa3a077 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:11.181159 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-df310255-0671-4a5e-8146-1ed39fa3a077 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:11.181987 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-df310255-0671-4a5e-8146-1ed39fa3a077 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:11.182442 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-df310255-0671-4a5e-8146-1ed39fa3a077 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:11.187505 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-df310255-0671-4a5e-8146-1ed39fa3a077 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:11.333166 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-df310255-0671-4a5e-8146-1ed39fa3a077 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:11.344699 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-df310255-0671-4a5e-8146-1ed39fa3a077 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5" status: 200 len: 1521 microversion: 2.1 time: 0.177402 Oct 17 03:55:11.376871 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 103/206] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:11 2022] GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:11.597020 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-daba2079-bded-4783-8b83-b50d81452067 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:11.597810 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-daba2079-bded-4783-8b83-b50d81452067 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] [instance: 146a05a0-dc55-4c0d-804b-0577d163cacb] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:11.604549 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-daba2079-bded-4783-8b83-b50d81452067 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:11.605158 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-daba2079-bded-4783-8b83-b50d81452067 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:11.605624 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-daba2079-bded-4783-8b83-b50d81452067 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:11.608265 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-daba2079-bded-4783-8b83-b50d81452067 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:11.608954 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-daba2079-bded-4783-8b83-b50d81452067 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:11.623159 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-daba2079-bded-4783-8b83-b50d81452067 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:11.897588 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-daba2079-bded-4783-8b83-b50d81452067 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27304fa6497b49e092b02173e5c516dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640a6e11de37477d9df98dc427bf810d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:11.901072 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_cell1:SELECT=100 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:55:11.906153 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-daba2079-bded-4783-8b83-b50d81452067 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] 10.222.0.16 "GET /compute/v2.1/servers/146a05a0-dc55-4c0d-804b-0577d163cacb" status: 200 len: 1314 microversion: 2.1 time: 0.320114 Oct 17 03:55:11.907021 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 104/207] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:11 2022] GET /compute/v2.1/servers/146a05a0-dc55-4c0d-804b-0577d163cacb => generated 1314 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:11.923735 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-0b59d773-ddfb-4e4c-8073-b244f7501e57 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:11.924691 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-0b59d773-ddfb-4e4c-8073-b244f7501e57 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] [instance: 5bced6b7-8194-4fa1-90c6-94251db2b3a9] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:11.931421 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0b59d773-ddfb-4e4c-8073-b244f7501e57 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:11.932088 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0b59d773-ddfb-4e4c-8073-b244f7501e57 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:11.932670 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0b59d773-ddfb-4e4c-8073-b244f7501e57 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:11.933553 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0b59d773-ddfb-4e4c-8073-b244f7501e57 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:11.934160 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0b59d773-ddfb-4e4c-8073-b244f7501e57 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:11.934769 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0b59d773-ddfb-4e4c-8073-b244f7501e57 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:12.028167 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-d05622fb-3bc4-4aaa-87a4-78bb2edd75b4 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Action: 'create', calling method: .version_select at 0x7fd72a883f70>, body: {"keypair": {"name": "tempest-keypair-1729030792", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBMMA6nF4DPD6VHKyNeIik2k9XcZsM/AqkRDUyYV4CWGbPrmt0WKst3kLlDUwsgory7oH/mniR2+3iN6C+XPFw7DJsupdAf2fH1KBRIsg3V5u7CPYmmv2/YpmlbGfsocfQ=="}} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:55:12.048637 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:55:12.055698 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.quota [None req-d05622fb-3bc4-4aaa-87a4-78bb2edd75b4 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Getting quotas for project 2301e8558e0148a481982b776c91e839. Resources: {'key_pairs'} {{(pid=125872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 03:55:12.060856 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.quota [None req-d05622fb-3bc4-4aaa-87a4-78bb2edd75b4 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Getting quotas for user 67fe62eeb9d043a59baa93def8d43265 and project 2301e8558e0148a481982b776c91e839. Resources: {'key_pairs'} {{(pid=125872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 03:55:12.119366 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_cell0:SELECT=2 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:55:12.162079 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-d05622fb-3bc4-4aaa-87a4-78bb2edd75b4 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.396870 Oct 17 03:55:12.165072 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 104/208] 10.222.0.16 () {62 vars in 1200 bytes} [Mon Oct 17 03:55:11 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 402 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 17 03:55:12.186221 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-0b59d773-ddfb-4e4c-8073-b244f7501e57 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445a5503db82419ebb96ac4518e37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1a41912e4cf45cf8409a238d3ed33bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:12.199950 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-0b59d773-ddfb-4e4c-8073-b244f7501e57 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] 10.222.0.16 "GET /compute/v2.1/servers/5bced6b7-8194-4fa1-90c6-94251db2b3a9" status: 200 len: 1503 microversion: 2.1 time: 0.279982 Oct 17 03:55:12.202614 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 105/209] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:11 2022] GET /compute/v2.1/servers/5bced6b7-8194-4fa1-90c6-94251db2b3a9 => generated 1503 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:12.380338 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-34420728-3d8b-4fe1-b994-44b887138f76 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:12.381112 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-34420728-3d8b-4fe1-b994-44b887138f76 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 15a2e41f-4480-429c-9207-8d95daa186f5] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:12.388752 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-34420728-3d8b-4fe1-b994-44b887138f76 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:12.389426 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-34420728-3d8b-4fe1-b994-44b887138f76 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:12.389863 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-34420728-3d8b-4fe1-b994-44b887138f76 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:12.390803 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-34420728-3d8b-4fe1-b994-44b887138f76 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:12.391281 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-34420728-3d8b-4fe1-b994-44b887138f76 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:12.391862 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-34420728-3d8b-4fe1-b994-44b887138f76 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:12.604589 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [req-6c9628e4-1ae0-4f3e-9473-dbe3d745ca59 req-14c1ac59-a215-4e8e-ab9e-a6dfba5e1de7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bced6b7-8194-4fa1-90c6-94251db2b3a9", "name": "network-vif-deleted", "tag": "607c008c-e2b0-45ad-b97f-cb1250da7e99"}]} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:55:12.617864 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-6c9628e4-1ae0-4f3e-9473-dbe3d745ca59 req-14c1ac59-a215-4e8e-ab9e-a6dfba5e1de7 service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:12.618363 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-6c9628e4-1ae0-4f3e-9473-dbe3d745ca59 req-14c1ac59-a215-4e8e-ab9e-a6dfba5e1de7 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:12.620646 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-6c9628e4-1ae0-4f3e-9473-dbe3d745ca59 req-14c1ac59-a215-4e8e-ab9e-a6dfba5e1de7 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:12.649781 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.compute.server_external_events [req-6c9628e4-1ae0-4f3e-9473-dbe3d745ca59 req-14c1ac59-a215-4e8e-ab9e-a6dfba5e1de7 service nova] Creating event network-vif-deleted:607c008c-e2b0-45ad-b97f-cb1250da7e99 for instance 5bced6b7-8194-4fa1-90c6-94251db2b3a9 on hv-cinder-81558 Oct 17 03:55:12.659521 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [req-6c9628e4-1ae0-4f3e-9473-dbe3d745ca59 req-14c1ac59-a215-4e8e-ab9e-a6dfba5e1de7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059185 Oct 17 03:55:12.660445 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 106/210] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 03:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 03:55:12.690967 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-34420728-3d8b-4fe1-b994-44b887138f76 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:12.700519 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-34420728-3d8b-4fe1-b994-44b887138f76 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5" status: 200 len: 1521 microversion: 2.1 time: 0.324897 Oct 17 03:55:12.701105 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 105/211] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:12 2022] GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5 => generated 1521 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:12.930499 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-b2fb8122-b748-4bd1-96fc-75bdc82c3a41 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:12.931486 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-b2fb8122-b748-4bd1-96fc-75bdc82c3a41 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] [instance: 146a05a0-dc55-4c0d-804b-0577d163cacb] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:12.939055 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b2fb8122-b748-4bd1-96fc-75bdc82c3a41 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:12.939756 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b2fb8122-b748-4bd1-96fc-75bdc82c3a41 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:12.940312 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b2fb8122-b748-4bd1-96fc-75bdc82c3a41 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:12.941144 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b2fb8122-b748-4bd1-96fc-75bdc82c3a41 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:12.941705 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b2fb8122-b748-4bd1-96fc-75bdc82c3a41 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:12.942365 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b2fb8122-b748-4bd1-96fc-75bdc82c3a41 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:13.142390 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-b2fb8122-b748-4bd1-96fc-75bdc82c3a41 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27304fa6497b49e092b02173e5c516dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640a6e11de37477d9df98dc427bf810d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:13.152364 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-b2fb8122-b748-4bd1-96fc-75bdc82c3a41 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] 10.222.0.16 "GET /compute/v2.1/servers/146a05a0-dc55-4c0d-804b-0577d163cacb" status: 200 len: 1314 microversion: 2.1 time: 0.225965 Oct 17 03:55:13.153120 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 107/212] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:12 2022] GET /compute/v2.1/servers/146a05a0-dc55-4c0d-804b-0577d163cacb => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:13.227623 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-a7ac1b75-7e00-4555-8d62-4db5042bdcb8 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:13.229042 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-a7ac1b75-7e00-4555-8d62-4db5042bdcb8 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] [instance: 5bced6b7-8194-4fa1-90c6-94251db2b3a9] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:13.243903 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a7ac1b75-7e00-4555-8d62-4db5042bdcb8 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:13.250843 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a7ac1b75-7e00-4555-8d62-4db5042bdcb8 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:13.250843 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a7ac1b75-7e00-4555-8d62-4db5042bdcb8 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:13.250843 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a7ac1b75-7e00-4555-8d62-4db5042bdcb8 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:13.250843 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a7ac1b75-7e00-4555-8d62-4db5042bdcb8 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:13.253228 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a7ac1b75-7e00-4555-8d62-4db5042bdcb8 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:13.304646 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a7ac1b75-7e00-4555-8d62-4db5042bdcb8 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:13.308180 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a7ac1b75-7e00-4555-8d62-4db5042bdcb8 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:13.308180 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a7ac1b75-7e00-4555-8d62-4db5042bdcb8 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:13.308180 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.objects.instance [None req-a7ac1b75-7e00-4555-8d62-4db5042bdcb8 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lazy-loading 'fault' on Instance uuid 5bced6b7-8194-4fa1-90c6-94251db2b3a9 {{(pid=125872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:55:13.362486 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-a7ac1b75-7e00-4555-8d62-4db5042bdcb8 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445a5503db82419ebb96ac4518e37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1a41912e4cf45cf8409a238d3ed33bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:13.370827 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-a7ac1b75-7e00-4555-8d62-4db5042bdcb8 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] 10.222.0.16 "GET /compute/v2.1/servers/5bced6b7-8194-4fa1-90c6-94251db2b3a9" status: 200 len: 1304 microversion: 2.1 time: 0.148366 Oct 17 03:55:13.377958 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 106/213] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:13 2022] GET /compute/v2.1/servers/5bced6b7-8194-4fa1-90c6-94251db2b3a9 => generated 1304 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:13.725339 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-331f0431-7986-496f-abca-b9bad7ab6a16 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:13.725956 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-331f0431-7986-496f-abca-b9bad7ab6a16 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 15a2e41f-4480-429c-9207-8d95daa186f5] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:13.748785 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-331f0431-7986-496f-abca-b9bad7ab6a16 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:13.748785 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-331f0431-7986-496f-abca-b9bad7ab6a16 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:13.748785 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-331f0431-7986-496f-abca-b9bad7ab6a16 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:13.748785 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-331f0431-7986-496f-abca-b9bad7ab6a16 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:13.749235 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-331f0431-7986-496f-abca-b9bad7ab6a16 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:13.749235 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-331f0431-7986-496f-abca-b9bad7ab6a16 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:13.909673 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-331f0431-7986-496f-abca-b9bad7ab6a16 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:13.918191 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-331f0431-7986-496f-abca-b9bad7ab6a16 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5" status: 200 len: 1521 microversion: 2.1 time: 0.198323 Oct 17 03:55:13.918815 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 108/214] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:13 2022] GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:14.176032 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-3cc3dde4-9d3d-4224-b789-398324fea854 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:14.176659 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-3cc3dde4-9d3d-4224-b789-398324fea854 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] [instance: 146a05a0-dc55-4c0d-804b-0577d163cacb] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:14.192964 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-3cc3dde4-9d3d-4224-b789-398324fea854 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:14.193463 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-3cc3dde4-9d3d-4224-b789-398324fea854 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:14.193909 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-3cc3dde4-9d3d-4224-b789-398324fea854 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:14.194610 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-3cc3dde4-9d3d-4224-b789-398324fea854 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:14.195065 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-3cc3dde4-9d3d-4224-b789-398324fea854 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:14.195564 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-3cc3dde4-9d3d-4224-b789-398324fea854 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:14.234397 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:55:14.396014 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-9bc74998-0935-4784-a2ba-5bc2653fce16 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:14.397514 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-9bc74998-0935-4784-a2ba-5bc2653fce16 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] [instance: 5bced6b7-8194-4fa1-90c6-94251db2b3a9] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:14.410813 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-9bc74998-0935-4784-a2ba-5bc2653fce16 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:14.418038 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-9bc74998-0935-4784-a2ba-5bc2653fce16 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:14.421301 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-9bc74998-0935-4784-a2ba-5bc2653fce16 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:14.424337 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-9bc74998-0935-4784-a2ba-5bc2653fce16 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:14.427633 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-9bc74998-0935-4784-a2ba-5bc2653fce16 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:14.430776 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-9bc74998-0935-4784-a2ba-5bc2653fce16 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:14.477460 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.wsgi [None req-9bc74998-0935-4784-a2ba-5bc2653fce16 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] HTTP exception thrown: Instance 5bced6b7-8194-4fa1-90c6-94251db2b3a9 could not be found. Oct 17 03:55:14.480451 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-9bc74998-0935-4784-a2ba-5bc2653fce16 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Request method failure captured: Oct 17 03:55:14.480451 dv-cinder-815582-16-smb devstack@n-api.service[125871]: request: GET /compute/v2.1/servers/5bced6b7-8194-4fa1-90c6-94251db2b3a9 HTTP/1.1 Oct 17 03:55:14.480451 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Accept: application/json Oct 17 03:55:14.480451 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Accept-Encoding: identity Oct 17 03:55:14.480451 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Connection: close Oct 17 03:55:14.480451 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Content-Length: 0 Oct 17 03:55:14.480451 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Content-Type: application/json Oct 17 03:55:14.480451 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Host: 10.222.0.16 Oct 17 03:55:14.480451 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Openstack-System-Scope: None Oct 17 03:55:14.480451 dv-cinder-815582-16-smb devstack@n-api.service[125871]: User-Agent: python-urllib3/1.26.12 Oct 17 03:55:14.480451 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Auth-Token: gAAAAABjTNIH5kFD0dskdN-X3b1GVUaobC7loW3pjUPhoFGPhBVup5v35hDvwIlzMMLHYSckgFYTBZHQdt_rQw1u6JisErq4InuA5bTQl5c2yS-Kougi6-9kEO8KaEbCczH6gElXXjnh-epC1UZySH7_HACo2ad87rB4jfPP9u4fByyazVJkg0M Oct 17 03:55:14.480451 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Domain-Id: None Oct 17 03:55:14.480451 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Domain-Name: None Oct 17 03:55:14.480451 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Identity-Status: Confirmed Oct 17 03:55:14.480451 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Is-Admin-Project: True Oct 17 03:55:14.480451 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Domain-Id: default Oct 17 03:55:14.480451 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Domain-Name: Default Oct 17 03:55:14.480451 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Id: b1a41912e4cf45cf8409a238d3ed33bf Oct 17 03:55:14.480451 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Name: tempest-VolumesActionsTest-946980975 Oct 17 03:55:14.480451 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Role: reader,member Oct 17 03:55:14.480451 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Roles: reader,member Oct 17 03:55:14.482552 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b1a41912e4cf45cf8409a238d3ed33bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b1a41912e4cf45cf8409a238d3ed33bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b1a41912e4cf45cf8409a238d3ed33bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b1a41912e4cf45cf8409a238d3ed33bf", "adminURL": "http://10.222.0.16:8080"}]}] Oct 17 03:55:14.482552 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant: tempest-VolumesActionsTest-946980975 Oct 17 03:55:14.482552 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant-Id: b1a41912e4cf45cf8409a238d3ed33bf Oct 17 03:55:14.482552 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant-Name: tempest-VolumesActionsTest-946980975 Oct 17 03:55:14.482552 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User: tempest-VolumesActionsTest-946980975-project Oct 17 03:55:14.482552 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Domain-Id: default Oct 17 03:55:14.482552 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Domain-Name: Default Oct 17 03:55:14.482552 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Id: 445a5503db82419ebb96ac4518e37447 Oct 17 03:55:14.482552 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Name: tempest-VolumesActionsTest-946980975-project Oct 17 03:55:14.482552 dv-cinder-815582-16-smb devstack@n-api.service[125871]: method: > Oct 17 03:55:14.482552 dv-cinder-815582-16-smb devstack@n-api.service[125871]: exception: Instance 5bced6b7-8194-4fa1-90c6-94251db2b3a9 could not be found. Oct 17 03:55:14.482552 dv-cinder-815582-16-smb devstack@n-api.service[125871]: action_args: {'id': '5bced6b7-8194-4fa1-90c6-94251db2b3a9'} Oct 17 03:55:14.483244 dv-cinder-815582-16-smb devstack@n-api.service[125871]: {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:55:14.483244 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:55:14.483244 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 03:55:14.483244 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 03:55:14.483244 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 03:55:14.483244 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 03:55:14.483244 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 03:55:14.483244 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 03:55:14.483244 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 03:55:14.483244 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 03:55:14.483244 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bced6b7-8194-4fa1-90c6-94251db2b3a9 could not be found. Oct 17 03:55:14.483244 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:55:14.483244 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:55:14.483244 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:55:14.483244 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:55:14.483244 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:55:14.483244 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:55:14.483244 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:55:14.483244 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:55:14.483244 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:55:14.485315 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:55:14.485315 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 03:55:14.485315 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 03:55:14.485315 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 03:55:14.485315 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 03:55:14.485315 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 03:55:14.485315 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:55:14.485315 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bced6b7-8194-4fa1-90c6-94251db2b3a9 could not be found. Oct 17 03:55:14.485315 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:55:14.485315 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:55:14.485315 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:55:14.485315 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:55:14.485315 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:55:14.485315 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:55:14.485315 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:55:14.485315 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:55:14.485315 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bced6b7-8194-4fa1-90c6-94251db2b3a9 could not be found. Oct 17 03:55:14.485315 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:55:14.494955 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-9bc74998-0935-4784-a2ba-5bc2653fce16 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] Returning 404 to user: Instance 5bced6b7-8194-4fa1-90c6-94251db2b3a9 could not be found. {{(pid=125871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:55:14.494955 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-9bc74998-0935-4784-a2ba-5bc2653fce16 tempest-VolumesActionsTest-946980975 tempest-VolumesActionsTest-946980975-project] 10.222.0.16 "GET /compute/v2.1/servers/5bced6b7-8194-4fa1-90c6-94251db2b3a9" status: 404 len: 111 microversion: 2.1 time: 0.093351 Oct 17 03:55:14.494955 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 109/215] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:14 2022] GET /compute/v2.1/servers/5bced6b7-8194-4fa1-90c6-94251db2b3a9 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 03:55:14.554165 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-3cc3dde4-9d3d-4224-b789-398324fea854 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27304fa6497b49e092b02173e5c516dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640a6e11de37477d9df98dc427bf810d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:14.567034 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-3cc3dde4-9d3d-4224-b789-398324fea854 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] 10.222.0.16 "GET /compute/v2.1/servers/146a05a0-dc55-4c0d-804b-0577d163cacb" status: 200 len: 1314 microversion: 2.1 time: 0.392770 Oct 17 03:55:14.567926 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 107/216] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:14 2022] GET /compute/v2.1/servers/146a05a0-dc55-4c0d-804b-0577d163cacb => generated 1314 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:14.755864 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [req-e85b1d1c-36c4-4452-b032-39265f829975 req-3550a10e-d97e-435b-a99d-660e1e58a43f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "146a05a0-dc55-4c0d-804b-0577d163cacb", "name": "network-vif-plugged", "status": "completed", "tag": "e6421995-619e-49f1-ad17-02977a0ac23e"}]} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:55:14.770893 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-e85b1d1c-36c4-4452-b032-39265f829975 req-3550a10e-d97e-435b-a99d-660e1e58a43f service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:14.773789 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-e85b1d1c-36c4-4452-b032-39265f829975 req-3550a10e-d97e-435b-a99d-660e1e58a43f service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:14.775580 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-e85b1d1c-36c4-4452-b032-39265f829975 req-3550a10e-d97e-435b-a99d-660e1e58a43f service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:14.788752 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.compute.server_external_events [req-e85b1d1c-36c4-4452-b032-39265f829975 req-3550a10e-d97e-435b-a99d-660e1e58a43f service nova] Creating event network-vif-plugged:e6421995-619e-49f1-ad17-02977a0ac23e for instance 146a05a0-dc55-4c0d-804b-0577d163cacb on hv-cinder-81558 Oct 17 03:55:14.793815 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [req-e85b1d1c-36c4-4452-b032-39265f829975 req-3550a10e-d97e-435b-a99d-660e1e58a43f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042892 Oct 17 03:55:14.794417 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 110/217] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 03:55:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 03:55:14.949736 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-2d924146-ba00-499e-9790-f49033d08ce7 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:14.949924 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-2d924146-ba00-499e-9790-f49033d08ce7 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 15a2e41f-4480-429c-9207-8d95daa186f5] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:14.961396 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2d924146-ba00-499e-9790-f49033d08ce7 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:14.961902 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2d924146-ba00-499e-9790-f49033d08ce7 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:14.962342 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2d924146-ba00-499e-9790-f49033d08ce7 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:14.963064 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2d924146-ba00-499e-9790-f49033d08ce7 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:14.967748 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2d924146-ba00-499e-9790-f49033d08ce7 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:14.968737 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2d924146-ba00-499e-9790-f49033d08ce7 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:15.111228 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-2d924146-ba00-499e-9790-f49033d08ce7 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:15.120037 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-2d924146-ba00-499e-9790-f49033d08ce7 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5" status: 200 len: 1521 microversion: 2.1 time: 0.179414 Oct 17 03:55:15.129398 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 108/218] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:14 2022] GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:15.162404 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-a75f70ec-173f-4aff-8579-cec3dc37f616 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1255144635", "imageRef": "add1979e-0a3b-4403-a8ae-8d9a7b045fc2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8f7eeeb3-31a1-4493-819a-88b3a1e30f20"}], "security_groups": [{"name": "tempest-securitygroup--38666776"}], "key_name": "tempest-keypair-1729030792", "user_data": "}} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:55:15.355732 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.network.neutron [None req-a75f70ec-173f-4aff-8579-cec3dc37f616 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] validate_networks() for [('8f7eeeb3-31a1-4493-819a-88b3a1e30f20', None, None, None, None, None)] {{(pid=125871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 03:55:15.593040 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-470f5dec-22ac-4cbd-929c-9956a1c955ec tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:15.593733 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-470f5dec-22ac-4cbd-929c-9956a1c955ec tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] [instance: 146a05a0-dc55-4c0d-804b-0577d163cacb] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:15.605142 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-470f5dec-22ac-4cbd-929c-9956a1c955ec tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:15.605854 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-470f5dec-22ac-4cbd-929c-9956a1c955ec tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:15.607817 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-470f5dec-22ac-4cbd-929c-9956a1c955ec tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:15.616955 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-470f5dec-22ac-4cbd-929c-9956a1c955ec tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:15.616955 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-470f5dec-22ac-4cbd-929c-9956a1c955ec tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:15.616955 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-470f5dec-22ac-4cbd-929c-9956a1c955ec tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:15.768195 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-470f5dec-22ac-4cbd-929c-9956a1c955ec tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27304fa6497b49e092b02173e5c516dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640a6e11de37477d9df98dc427bf810d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:15.776579 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-470f5dec-22ac-4cbd-929c-9956a1c955ec tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] 10.222.0.16 "GET /compute/v2.1/servers/146a05a0-dc55-4c0d-804b-0577d163cacb" status: 200 len: 1314 microversion: 2.1 time: 0.189815 Oct 17 03:55:15.780568 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.virt.hardware [None req-a75f70ec-173f-4aff-8579-cec3dc37f616 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Flavor limits 0:0:0 {{(pid=125871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 03:55:15.781042 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.virt.hardware [None req-a75f70ec-173f-4aff-8579-cec3dc37f616 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Image limits 0:0:0 {{(pid=125871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 03:55:15.785488 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.virt.hardware [None req-a75f70ec-173f-4aff-8579-cec3dc37f616 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Flavor pref 0:0:0 {{(pid=125871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 03:55:15.785488 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.virt.hardware [None req-a75f70ec-173f-4aff-8579-cec3dc37f616 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Image pref 0:0:0 {{(pid=125871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 03:55:15.785488 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.virt.hardware [None req-a75f70ec-173f-4aff-8579-cec3dc37f616 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 03:55:15.787853 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 109/219] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:15 2022] GET /compute/v2.1/servers/146a05a0-dc55-4c0d-804b-0577d163cacb => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:55:15.796296 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a75f70ec-173f-4aff-8579-cec3dc37f616 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:15.796788 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a75f70ec-173f-4aff-8579-cec3dc37f616 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:15.797230 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a75f70ec-173f-4aff-8579-cec3dc37f616 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:15.798012 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a75f70ec-173f-4aff-8579-cec3dc37f616 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:15.798470 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a75f70ec-173f-4aff-8579-cec3dc37f616 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:15.798895 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a75f70ec-173f-4aff-8579-cec3dc37f616 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:15.817434 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.quota [None req-a75f70ec-173f-4aff-8579-cec3dc37f616 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Getting quotas for project 2301e8558e0148a481982b776c91e839. Resources: {'cores', 'instances', 'ram'} {{(pid=125871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 03:55:15.821411 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.quota [None req-a75f70ec-173f-4aff-8579-cec3dc37f616 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Getting quotas for user 67fe62eeb9d043a59baa93def8d43265 and project 2301e8558e0148a481982b776c91e839. Resources: {'cores', 'instances', 'ram'} {{(pid=125871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 03:55:15.833485 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-a75f70ec-173f-4aff-8579-cec3dc37f616 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Going to run 1 instances... {{(pid=125871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 03:55:15.836166 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-a75f70ec-173f-4aff-8579-cec3dc37f616 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='add1979e-0a3b-4403-a8ae-8d9a7b045fc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 03:55:15.983133 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-a75f70ec-173f-4aff-8579-cec3dc37f616 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.825996 Oct 17 03:55:15.997367 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-32689fc6-5e70-4c78-b7db-7ac3e926b016 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:15.997989 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-32689fc6-5e70-4c78-b7db-7ac3e926b016 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:16.004362 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 111/220] 10.222.0.16 () {62 vars in 1188 bytes} [Mon Oct 17 03:55:15 2022] POST /compute/v2.1/servers => generated 400 bytes in 849 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 17 03:55:16.065658 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-32689fc6-5e70-4c78-b7db-7ac3e926b016 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:16.076396 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-32689fc6-5e70-4c78-b7db-7ac3e926b016 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:16.078107 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-32689fc6-5e70-4c78-b7db-7ac3e926b016 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:16.079608 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-32689fc6-5e70-4c78-b7db-7ac3e926b016 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1282 microversion: 2.20 time: 0.087655 Oct 17 03:55:16.092551 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 110/221] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:55:15 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1282 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:55:16.145862 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-dcf5dc66-bce8-4692-9ab4-297942560c4c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:16.146897 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-dcf5dc66-bce8-4692-9ab4-297942560c4c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 15a2e41f-4480-429c-9207-8d95daa186f5] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:16.159263 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-dcf5dc66-bce8-4692-9ab4-297942560c4c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:16.160408 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-dcf5dc66-bce8-4692-9ab4-297942560c4c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:16.162576 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-dcf5dc66-bce8-4692-9ab4-297942560c4c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:16.164492 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-dcf5dc66-bce8-4692-9ab4-297942560c4c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:16.166845 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-dcf5dc66-bce8-4692-9ab4-297942560c4c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:16.167323 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-dcf5dc66-bce8-4692-9ab4-297942560c4c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:16.335088 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-dcf5dc66-bce8-4692-9ab4-297942560c4c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:16.349192 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-dcf5dc66-bce8-4692-9ab4-297942560c4c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5" status: 200 len: 1521 microversion: 2.1 time: 0.208516 Oct 17 03:55:16.355693 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 112/222] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:16 2022] GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5 => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:16.800863 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-900e5171-c06f-477b-b371-298ca1977ba2 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:16.801501 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-900e5171-c06f-477b-b371-298ca1977ba2 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] [instance: 146a05a0-dc55-4c0d-804b-0577d163cacb] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:16.810253 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-900e5171-c06f-477b-b371-298ca1977ba2 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:16.810785 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-900e5171-c06f-477b-b371-298ca1977ba2 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:16.811243 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-900e5171-c06f-477b-b371-298ca1977ba2 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:16.811942 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-900e5171-c06f-477b-b371-298ca1977ba2 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:16.812396 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-900e5171-c06f-477b-b371-298ca1977ba2 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:16.812845 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-900e5171-c06f-477b-b371-298ca1977ba2 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:16.956058 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-900e5171-c06f-477b-b371-298ca1977ba2 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27304fa6497b49e092b02173e5c516dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640a6e11de37477d9df98dc427bf810d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:16.964351 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-900e5171-c06f-477b-b371-298ca1977ba2 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] 10.222.0.16 "GET /compute/v2.1/servers/146a05a0-dc55-4c0d-804b-0577d163cacb" status: 200 len: 1314 microversion: 2.1 time: 0.167363 Oct 17 03:55:16.964930 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 111/223] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:16 2022] GET /compute/v2.1/servers/146a05a0-dc55-4c0d-804b-0577d163cacb => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:17.107408 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-38031b5e-1f5c-4d09-adf7-181c5f0732b8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:17.108103 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-38031b5e-1f5c-4d09-adf7-181c5f0732b8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:17.163309 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-38031b5e-1f5c-4d09-adf7-181c5f0732b8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:17.177121 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-38031b5e-1f5c-4d09-adf7-181c5f0732b8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:17.178554 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-38031b5e-1f5c-4d09-adf7-181c5f0732b8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:17.179742 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-38031b5e-1f5c-4d09-adf7-181c5f0732b8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1282 microversion: 2.20 time: 0.077238 Oct 17 03:55:17.180333 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 113/224] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:55:17 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1282 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:55:17.373606 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-922630ba-e547-4c8c-bf4c-5d0a34c4c2d4 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:17.374316 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-922630ba-e547-4c8c-bf4c-5d0a34c4c2d4 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 15a2e41f-4480-429c-9207-8d95daa186f5] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:17.382036 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-922630ba-e547-4c8c-bf4c-5d0a34c4c2d4 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:17.382775 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-922630ba-e547-4c8c-bf4c-5d0a34c4c2d4 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:17.383281 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-922630ba-e547-4c8c-bf4c-5d0a34c4c2d4 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:17.388674 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-922630ba-e547-4c8c-bf4c-5d0a34c4c2d4 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:17.388674 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-922630ba-e547-4c8c-bf4c-5d0a34c4c2d4 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:17.388674 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-922630ba-e547-4c8c-bf4c-5d0a34c4c2d4 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:17.528705 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-922630ba-e547-4c8c-bf4c-5d0a34c4c2d4 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:17.540814 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-922630ba-e547-4c8c-bf4c-5d0a34c4c2d4 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5" status: 200 len: 1521 microversion: 2.1 time: 0.172193 Oct 17 03:55:17.541390 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 112/225] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:17 2022] GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:17.988644 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-c01ee641-10f4-4089-b8e0-088e0e146f3a tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:17.989249 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-c01ee641-10f4-4089-b8e0-088e0e146f3a tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] [instance: 146a05a0-dc55-4c0d-804b-0577d163cacb] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:17.995261 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c01ee641-10f4-4089-b8e0-088e0e146f3a tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:17.995758 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c01ee641-10f4-4089-b8e0-088e0e146f3a tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:17.996633 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c01ee641-10f4-4089-b8e0-088e0e146f3a tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:17.997546 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c01ee641-10f4-4089-b8e0-088e0e146f3a tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:17.998093 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c01ee641-10f4-4089-b8e0-088e0e146f3a tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:17.998522 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c01ee641-10f4-4089-b8e0-088e0e146f3a tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:18.134442 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-c01ee641-10f4-4089-b8e0-088e0e146f3a tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27304fa6497b49e092b02173e5c516dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640a6e11de37477d9df98dc427bf810d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:18.143991 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-c01ee641-10f4-4089-b8e0-088e0e146f3a tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] 10.222.0.16 "GET /compute/v2.1/servers/146a05a0-dc55-4c0d-804b-0577d163cacb" status: 200 len: 1464 microversion: 2.1 time: 0.159114 Oct 17 03:55:18.144903 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 114/226] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:17 2022] GET /compute/v2.1/servers/146a05a0-dc55-4c0d-804b-0577d163cacb => generated 1464 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:18.192158 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-f46b085e-9e1e-4f54-bf65-25867e15067f tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:18.192739 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-f46b085e-9e1e-4f54-bf65-25867e15067f tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] [instance: 146a05a0-dc55-4c0d-804b-0577d163cacb] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:18.198746 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f46b085e-9e1e-4f54-bf65-25867e15067f tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:18.199490 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f46b085e-9e1e-4f54-bf65-25867e15067f tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:18.200199 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f46b085e-9e1e-4f54-bf65-25867e15067f tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:18.201219 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f46b085e-9e1e-4f54-bf65-25867e15067f tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:18.201889 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f46b085e-9e1e-4f54-bf65-25867e15067f tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:18.202320 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f46b085e-9e1e-4f54-bf65-25867e15067f tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:18.205493 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-b8206a6c-7fab-40af-a833-6a1101225392 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:18.208138 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-b8206a6c-7fab-40af-a833-6a1101225392 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:18.212939 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b8206a6c-7fab-40af-a833-6a1101225392 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:18.213434 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b8206a6c-7fab-40af-a833-6a1101225392 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:18.213859 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b8206a6c-7fab-40af-a833-6a1101225392 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:18.214572 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b8206a6c-7fab-40af-a833-6a1101225392 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:18.215001 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b8206a6c-7fab-40af-a833-6a1101225392 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:18.215517 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b8206a6c-7fab-40af-a833-6a1101225392 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:18.232596 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-f46b085e-9e1e-4f54-bf65-25867e15067f tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] [instance: 146a05a0-dc55-4c0d-804b-0577d163cacb] Going to try to terminate instance {{(pid=125872) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 03:55:18.288818 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-b8206a6c-7fab-40af-a833-6a1101225392 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:18.297755 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-b8206a6c-7fab-40af-a833-6a1101225392 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:18.299239 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-b8206a6c-7fab-40af-a833-6a1101225392 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:18.300348 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-b8206a6c-7fab-40af-a833-6a1101225392 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1278 microversion: 2.20 time: 0.098884 Oct 17 03:55:18.300946 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 115/227] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:55:18 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1278 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:55:18.564977 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-d1b7a809-b306-493d-86ab-108380b39229 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:18.565885 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-d1b7a809-b306-493d-86ab-108380b39229 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 15a2e41f-4480-429c-9207-8d95daa186f5] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:18.571721 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d1b7a809-b306-493d-86ab-108380b39229 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:18.572127 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d1b7a809-b306-493d-86ab-108380b39229 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:18.573051 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d1b7a809-b306-493d-86ab-108380b39229 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:18.574610 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d1b7a809-b306-493d-86ab-108380b39229 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:18.576069 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d1b7a809-b306-493d-86ab-108380b39229 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:18.576644 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d1b7a809-b306-493d-86ab-108380b39229 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:18.591900 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-f46b085e-9e1e-4f54-bf65-25867e15067f tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] 10.222.0.16 "DELETE /compute/v2.1/servers/146a05a0-dc55-4c0d-804b-0577d163cacb" status: 204 len: 0 microversion: 2.1 time: 0.402868 Oct 17 03:55:18.599999 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 113/228] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 17 03:55:18 2022] DELETE /compute/v2.1/servers/146a05a0-dc55-4c0d-804b-0577d163cacb => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 03:55:18.603353 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-4b189d98-c5bf-4c03-ae72-0c5d8f800732 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:18.604762 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-4b189d98-c5bf-4c03-ae72-0c5d8f800732 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] [instance: 146a05a0-dc55-4c0d-804b-0577d163cacb] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:18.612652 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-4b189d98-c5bf-4c03-ae72-0c5d8f800732 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:18.613229 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-4b189d98-c5bf-4c03-ae72-0c5d8f800732 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:18.613727 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-4b189d98-c5bf-4c03-ae72-0c5d8f800732 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:18.614495 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-4b189d98-c5bf-4c03-ae72-0c5d8f800732 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:18.615043 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-4b189d98-c5bf-4c03-ae72-0c5d8f800732 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:18.615492 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-4b189d98-c5bf-4c03-ae72-0c5d8f800732 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:18.715428 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-d1b7a809-b306-493d-86ab-108380b39229 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:18.724462 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-d1b7a809-b306-493d-86ab-108380b39229 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5" status: 200 len: 1521 microversion: 2.1 time: 0.163056 Oct 17 03:55:18.725350 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 116/229] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:18 2022] GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:55:18.762270 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-4b189d98-c5bf-4c03-ae72-0c5d8f800732 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27304fa6497b49e092b02173e5c516dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640a6e11de37477d9df98dc427bf810d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:18.770632 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-4b189d98-c5bf-4c03-ae72-0c5d8f800732 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] 10.222.0.16 "GET /compute/v2.1/servers/146a05a0-dc55-4c0d-804b-0577d163cacb" status: 200 len: 1470 microversion: 2.1 time: 0.173193 Oct 17 03:55:18.771521 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 114/230] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:18 2022] GET /compute/v2.1/servers/146a05a0-dc55-4c0d-804b-0577d163cacb => generated 1470 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:55:19.326544 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-d19ceed2-5c7f-40a7-b7ec-66bdec957f1e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:19.327926 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-d19ceed2-5c7f-40a7-b7ec-66bdec957f1e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:19.334471 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d19ceed2-5c7f-40a7-b7ec-66bdec957f1e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:19.335342 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d19ceed2-5c7f-40a7-b7ec-66bdec957f1e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:19.338624 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d19ceed2-5c7f-40a7-b7ec-66bdec957f1e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:19.339751 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d19ceed2-5c7f-40a7-b7ec-66bdec957f1e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:19.340355 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d19ceed2-5c7f-40a7-b7ec-66bdec957f1e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:19.340922 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d19ceed2-5c7f-40a7-b7ec-66bdec957f1e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:19.418151 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-d19ceed2-5c7f-40a7-b7ec-66bdec957f1e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:19.428221 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-d19ceed2-5c7f-40a7-b7ec-66bdec957f1e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:19.429720 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-d19ceed2-5c7f-40a7-b7ec-66bdec957f1e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:19.431153 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-d19ceed2-5c7f-40a7-b7ec-66bdec957f1e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1334 microversion: 2.20 time: 0.108530 Oct 17 03:55:19.431732 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 117/231] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:55:19 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1334 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:55:19.753779 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-10b64cd5-3500-4ce3-97f1-f1db1bfc18d1 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:19.755308 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-10b64cd5-3500-4ce3-97f1-f1db1bfc18d1 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 15a2e41f-4480-429c-9207-8d95daa186f5] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:19.763206 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-10b64cd5-3500-4ce3-97f1-f1db1bfc18d1 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:19.763916 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-10b64cd5-3500-4ce3-97f1-f1db1bfc18d1 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:19.764843 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-10b64cd5-3500-4ce3-97f1-f1db1bfc18d1 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:19.765854 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-10b64cd5-3500-4ce3-97f1-f1db1bfc18d1 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:19.766464 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-10b64cd5-3500-4ce3-97f1-f1db1bfc18d1 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:19.767189 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-10b64cd5-3500-4ce3-97f1-f1db1bfc18d1 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:19.796331 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-bb98cd4c-46c8-4eca-b585-401e6395034e tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:19.797267 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-bb98cd4c-46c8-4eca-b585-401e6395034e tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] [instance: 146a05a0-dc55-4c0d-804b-0577d163cacb] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:19.808092 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:55:19.808092 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-bb98cd4c-46c8-4eca-b585-401e6395034e tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:19.808092 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-bb98cd4c-46c8-4eca-b585-401e6395034e tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:19.808092 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-bb98cd4c-46c8-4eca-b585-401e6395034e tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:19.808424 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-bb98cd4c-46c8-4eca-b585-401e6395034e tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:19.808424 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-bb98cd4c-46c8-4eca-b585-401e6395034e tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:19.808856 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-bb98cd4c-46c8-4eca-b585-401e6395034e tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:19.932776 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-10b64cd5-3500-4ce3-97f1-f1db1bfc18d1 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:19.940880 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-10b64cd5-3500-4ce3-97f1-f1db1bfc18d1 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5" status: 200 len: 1501 microversion: 2.1 time: 0.192545 Oct 17 03:55:19.941490 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 115/232] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:19 2022] GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5 => generated 1501 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:19.963690 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-54cfc3df-a22a-41d0-892b-108db1a85549 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:19.964305 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-54cfc3df-a22a-41d0-892b-108db1a85549 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 06e9c5ca-8770-4ed5-90ae-bad248ab7ff7] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:19.972219 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-54cfc3df-a22a-41d0-892b-108db1a85549 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:19.972786 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-54cfc3df-a22a-41d0-892b-108db1a85549 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:19.973443 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-54cfc3df-a22a-41d0-892b-108db1a85549 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:19.974331 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-54cfc3df-a22a-41d0-892b-108db1a85549 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:19.975145 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-54cfc3df-a22a-41d0-892b-108db1a85549 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:19.975621 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-54cfc3df-a22a-41d0-892b-108db1a85549 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:20.008103 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-bb98cd4c-46c8-4eca-b585-401e6395034e tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27304fa6497b49e092b02173e5c516dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640a6e11de37477d9df98dc427bf810d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:20.017216 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-bb98cd4c-46c8-4eca-b585-401e6395034e tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] 10.222.0.16 "GET /compute/v2.1/servers/146a05a0-dc55-4c0d-804b-0577d163cacb" status: 200 len: 1470 microversion: 2.1 time: 0.226839 Oct 17 03:55:20.018430 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 118/233] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:19 2022] GET /compute/v2.1/servers/146a05a0-dc55-4c0d-804b-0577d163cacb => generated 1470 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:20.140576 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-54cfc3df-a22a-41d0-892b-108db1a85549 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:20.148543 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-54cfc3df-a22a-41d0-892b-108db1a85549 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7" status: 200 len: 1515 microversion: 2.1 time: 0.189313 Oct 17 03:55:20.155803 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 116/234] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:19 2022] GET /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7 => generated 1515 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:55:20.462438 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-d9addb3e-4676-44bc-a275-95bde378a646 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:20.463044 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-d9addb3e-4676-44bc-a275-95bde378a646 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:20.470166 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d9addb3e-4676-44bc-a275-95bde378a646 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:20.470709 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d9addb3e-4676-44bc-a275-95bde378a646 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:20.471329 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d9addb3e-4676-44bc-a275-95bde378a646 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:20.472030 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d9addb3e-4676-44bc-a275-95bde378a646 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:20.472683 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d9addb3e-4676-44bc-a275-95bde378a646 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:20.473653 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d9addb3e-4676-44bc-a275-95bde378a646 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:20.537026 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-d9addb3e-4676-44bc-a275-95bde378a646 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:20.545662 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-d9addb3e-4676-44bc-a275-95bde378a646 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:20.547118 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-d9addb3e-4676-44bc-a275-95bde378a646 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:20.548243 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-d9addb3e-4676-44bc-a275-95bde378a646 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1334 microversion: 2.20 time: 0.090082 Oct 17 03:55:20.548781 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 119/235] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:55:20 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1334 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:55:21.046689 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-91c7befd-7fcf-4697-b481-729be9368e37 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:21.047482 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-91c7befd-7fcf-4697-b481-729be9368e37 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] [instance: 146a05a0-dc55-4c0d-804b-0577d163cacb] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:21.057064 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-91c7befd-7fcf-4697-b481-729be9368e37 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:21.058069 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-91c7befd-7fcf-4697-b481-729be9368e37 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:21.058406 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-91c7befd-7fcf-4697-b481-729be9368e37 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:21.058854 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-91c7befd-7fcf-4697-b481-729be9368e37 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:21.060044 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-91c7befd-7fcf-4697-b481-729be9368e37 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:21.060476 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-91c7befd-7fcf-4697-b481-729be9368e37 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:21.304895 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-91c7befd-7fcf-4697-b481-729be9368e37 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27304fa6497b49e092b02173e5c516dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640a6e11de37477d9df98dc427bf810d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:21.317681 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-91c7befd-7fcf-4697-b481-729be9368e37 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] 10.222.0.16 "GET /compute/v2.1/servers/146a05a0-dc55-4c0d-804b-0577d163cacb" status: 200 len: 1470 microversion: 2.1 time: 0.274540 Oct 17 03:55:21.319710 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 117/236] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:21 2022] GET /compute/v2.1/servers/146a05a0-dc55-4c0d-804b-0577d163cacb => generated 1470 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:21.574140 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-51d0f465-62fc-4a24-94de-edf9371f1ff8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:21.574751 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-51d0f465-62fc-4a24-94de-edf9371f1ff8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:21.581604 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-51d0f465-62fc-4a24-94de-edf9371f1ff8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:21.582093 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-51d0f465-62fc-4a24-94de-edf9371f1ff8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:21.582526 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-51d0f465-62fc-4a24-94de-edf9371f1ff8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:21.583239 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-51d0f465-62fc-4a24-94de-edf9371f1ff8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:21.583849 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-51d0f465-62fc-4a24-94de-edf9371f1ff8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:21.584433 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-51d0f465-62fc-4a24-94de-edf9371f1ff8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:21.668465 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-51d0f465-62fc-4a24-94de-edf9371f1ff8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:21.678254 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-51d0f465-62fc-4a24-94de-edf9371f1ff8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:21.679932 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-51d0f465-62fc-4a24-94de-edf9371f1ff8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:21.681131 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-51d0f465-62fc-4a24-94de-edf9371f1ff8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1352 microversion: 2.20 time: 0.111362 Oct 17 03:55:21.681694 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 120/237] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:55:21 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1352 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:55:21.800152 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [req-72ccee09-93c0-458a-875f-f6a8f2c224d3 req-15217025-80a5-41f3-8e38-c376423cfb3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "146a05a0-dc55-4c0d-804b-0577d163cacb", "name": "network-vif-deleted", "tag": "e6421995-619e-49f1-ad17-02977a0ac23e"}]} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:55:21.811742 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-72ccee09-93c0-458a-875f-f6a8f2c224d3 req-15217025-80a5-41f3-8e38-c376423cfb3f service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:21.812250 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-72ccee09-93c0-458a-875f-f6a8f2c224d3 req-15217025-80a5-41f3-8e38-c376423cfb3f service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:21.812961 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-72ccee09-93c0-458a-875f-f6a8f2c224d3 req-15217025-80a5-41f3-8e38-c376423cfb3f service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:21.828187 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.compute.server_external_events [req-72ccee09-93c0-458a-875f-f6a8f2c224d3 req-15217025-80a5-41f3-8e38-c376423cfb3f service nova] Creating event network-vif-deleted:e6421995-619e-49f1-ad17-02977a0ac23e for instance 146a05a0-dc55-4c0d-804b-0577d163cacb on hv-cinder-81558 Oct 17 03:55:21.834334 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [req-72ccee09-93c0-458a-875f-f6a8f2c224d3 req-15217025-80a5-41f3-8e38-c376423cfb3f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038412 Oct 17 03:55:21.835344 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 118/238] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 03:55:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:55:22.266012 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-77cdac93-38ab-417a-a0a5-5d6102bdb5e9 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:55:22.268417 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-77cdac93-38ab-417a-a0a5-5d6102bdb5e9 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 06e9c5ca-8770-4ed5-90ae-bad248ab7ff7] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:22.274527 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-77cdac93-38ab-417a-a0a5-5d6102bdb5e9 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:22.275228 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-77cdac93-38ab-417a-a0a5-5d6102bdb5e9 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:22.275828 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-77cdac93-38ab-417a-a0a5-5d6102bdb5e9 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:22.276532 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-77cdac93-38ab-417a-a0a5-5d6102bdb5e9 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:22.276991 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-77cdac93-38ab-417a-a0a5-5d6102bdb5e9 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:22.277446 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-77cdac93-38ab-417a-a0a5-5d6102bdb5e9 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:22.311113 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.objects.instance [None req-77cdac93-38ab-417a-a0a5-5d6102bdb5e9 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lazy-loading 'flavor' on Instance uuid 06e9c5ca-8770-4ed5-90ae-bad248ab7ff7 {{(pid=125871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:55:22.343436 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-5c72d7c6-f704-461d-b2dc-dc6b739e6266 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:22.344153 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-5c72d7c6-f704-461d-b2dc-dc6b739e6266 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] [instance: 146a05a0-dc55-4c0d-804b-0577d163cacb] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:22.354748 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-5c72d7c6-f704-461d-b2dc-dc6b739e6266 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:22.358716 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-5c72d7c6-f704-461d-b2dc-dc6b739e6266 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:22.359461 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-5c72d7c6-f704-461d-b2dc-dc6b739e6266 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:22.360396 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-5c72d7c6-f704-461d-b2dc-dc6b739e6266 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:22.363762 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-5c72d7c6-f704-461d-b2dc-dc6b739e6266 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:22.364530 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-5c72d7c6-f704-461d-b2dc-dc6b739e6266 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:22.416122 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-5c72d7c6-f704-461d-b2dc-dc6b739e6266 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:22.417236 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-5c72d7c6-f704-461d-b2dc-dc6b739e6266 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:22.417907 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-5c72d7c6-f704-461d-b2dc-dc6b739e6266 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:22.419096 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.objects.instance [None req-5c72d7c6-f704-461d-b2dc-dc6b739e6266 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lazy-loading 'fault' on Instance uuid 146a05a0-dc55-4c0d-804b-0577d163cacb {{(pid=125872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:55:22.479476 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-5c72d7c6-f704-461d-b2dc-dc6b739e6266 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27304fa6497b49e092b02173e5c516dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640a6e11de37477d9df98dc427bf810d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:22.489875 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-5c72d7c6-f704-461d-b2dc-dc6b739e6266 tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] 10.222.0.16 "GET /compute/v2.1/servers/146a05a0-dc55-4c0d-804b-0577d163cacb" status: 200 len: 1304 microversion: 2.1 time: 0.151400 Oct 17 03:55:22.491456 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 119/239] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:22 2022] GET /compute/v2.1/servers/146a05a0-dc55-4c0d-804b-0577d163cacb => generated 1304 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:55:22.616593 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-77cdac93-38ab-417a-a0a5-5d6102bdb5e9 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "POST /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7/action" status: 200 len: 32 microversion: 2.1 time: 0.354748 Oct 17 03:55:22.617190 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 121/240] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 17 03:55:22 2022] POST /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7/action => generated 32 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 03:55:22.627158 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-f551f992-205b-4ab9-be2f-b526a8d7a8cb tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:22.627803 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-f551f992-205b-4ab9-be2f-b526a8d7a8cb tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 06e9c5ca-8770-4ed5-90ae-bad248ab7ff7] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:22.633637 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f551f992-205b-4ab9-be2f-b526a8d7a8cb tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:22.634122 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f551f992-205b-4ab9-be2f-b526a8d7a8cb tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:22.634564 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f551f992-205b-4ab9-be2f-b526a8d7a8cb tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:22.635552 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f551f992-205b-4ab9-be2f-b526a8d7a8cb tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:22.636012 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f551f992-205b-4ab9-be2f-b526a8d7a8cb tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:22.636439 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f551f992-205b-4ab9-be2f-b526a8d7a8cb tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:22.714412 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-3b40e850-9f49-485e-b4cc-1c8bb28de003 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:22.716270 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-3b40e850-9f49-485e-b4cc-1c8bb28de003 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:22.729375 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3b40e850-9f49-485e-b4cc-1c8bb28de003 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:22.730178 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3b40e850-9f49-485e-b4cc-1c8bb28de003 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:22.730617 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3b40e850-9f49-485e-b4cc-1c8bb28de003 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:22.732153 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3b40e850-9f49-485e-b4cc-1c8bb28de003 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:22.732615 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3b40e850-9f49-485e-b4cc-1c8bb28de003 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:22.733035 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3b40e850-9f49-485e-b4cc-1c8bb28de003 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:22.790188 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-f551f992-205b-4ab9-be2f-b526a8d7a8cb tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:22.798810 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-f551f992-205b-4ab9-be2f-b526a8d7a8cb tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7" status: 200 len: 1521 microversion: 2.1 time: 0.175496 Oct 17 03:55:22.800410 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 120/241] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:22 2022] GET /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:22.898362 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-3b40e850-9f49-485e-b4cc-1c8bb28de003 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:22.926023 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-3b40e850-9f49-485e-b4cc-1c8bb28de003 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:22.926023 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-3b40e850-9f49-485e-b4cc-1c8bb28de003 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:22.926023 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-3b40e850-9f49-485e-b4cc-1c8bb28de003 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1406 microversion: 2.20 time: 0.214697 Oct 17 03:55:22.926279 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 122/242] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:55:22 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1406 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:55:23.515081 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-554b370d-a0e0-4b8d-a21d-c08788d6332d tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:23.524072 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-554b370d-a0e0-4b8d-a21d-c08788d6332d tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] [instance: 146a05a0-dc55-4c0d-804b-0577d163cacb] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:23.524737 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-554b370d-a0e0-4b8d-a21d-c08788d6332d tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:23.525433 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-554b370d-a0e0-4b8d-a21d-c08788d6332d tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:23.525858 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-554b370d-a0e0-4b8d-a21d-c08788d6332d tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:23.526762 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-554b370d-a0e0-4b8d-a21d-c08788d6332d tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:23.527424 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-554b370d-a0e0-4b8d-a21d-c08788d6332d tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:23.527894 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-554b370d-a0e0-4b8d-a21d-c08788d6332d tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:23.543704 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.wsgi [None req-554b370d-a0e0-4b8d-a21d-c08788d6332d tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] HTTP exception thrown: Instance 146a05a0-dc55-4c0d-804b-0577d163cacb could not be found. Oct 17 03:55:23.546154 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-554b370d-a0e0-4b8d-a21d-c08788d6332d tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Request method failure captured: Oct 17 03:55:23.546154 dv-cinder-815582-16-smb devstack@n-api.service[125872]: request: GET /compute/v2.1/servers/146a05a0-dc55-4c0d-804b-0577d163cacb HTTP/1.1 Oct 17 03:55:23.546154 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Accept: application/json Oct 17 03:55:23.546154 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Accept-Encoding: identity Oct 17 03:55:23.546154 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Connection: close Oct 17 03:55:23.546154 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Content-Length: 0 Oct 17 03:55:23.546154 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Content-Type: application/json Oct 17 03:55:23.546154 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Host: 10.222.0.16 Oct 17 03:55:23.546154 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Openstack-System-Scope: None Oct 17 03:55:23.546154 dv-cinder-815582-16-smb devstack@n-api.service[125872]: User-Agent: python-urllib3/1.26.12 Oct 17 03:55:23.546154 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Auth-Token: gAAAAABjTNIRBikpmJNvI1DpmSAJkBw0ufcPn6W21aTPjILbcDv8m6NZaMZtg8gNQLH6M4Jd1ObA-L9K59j3MA-SRiVdpz2B18xs9MAer3Rba-JWz_vrmNy00aa0EJwx1NJdPuonFaJnZmdDdoKrXTafTieb4WUZTyQ1HlLV6cXxYfLYaYhkR5g Oct 17 03:55:23.546154 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Domain-Id: None Oct 17 03:55:23.546154 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Domain-Name: None Oct 17 03:55:23.546154 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Identity-Status: Confirmed Oct 17 03:55:23.546154 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Is-Admin-Project: True Oct 17 03:55:23.546154 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Domain-Id: default Oct 17 03:55:23.546154 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Domain-Name: Default Oct 17 03:55:23.546154 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Id: 640a6e11de37477d9df98dc427bf810d Oct 17 03:55:23.546154 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Name: tempest-VolumesNegativeTest-380343807 Oct 17 03:55:23.546154 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Role: reader,member Oct 17 03:55:23.546154 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Roles: reader,member Oct 17 03:55:23.547489 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/640a6e11de37477d9df98dc427bf810d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/640a6e11de37477d9df98dc427bf810d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/640a6e11de37477d9df98dc427bf810d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_640a6e11de37477d9df98dc427bf810d", "adminURL": "http://10.222.0.16:8080"}]}] Oct 17 03:55:23.547489 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant: tempest-VolumesNegativeTest-380343807 Oct 17 03:55:23.547489 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant-Id: 640a6e11de37477d9df98dc427bf810d Oct 17 03:55:23.547489 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant-Name: tempest-VolumesNegativeTest-380343807 Oct 17 03:55:23.547489 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User: tempest-VolumesNegativeTest-380343807-project Oct 17 03:55:23.547489 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Domain-Id: default Oct 17 03:55:23.547489 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Domain-Name: Default Oct 17 03:55:23.547489 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Id: 27304fa6497b49e092b02173e5c516dc Oct 17 03:55:23.547489 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Name: tempest-VolumesNegativeTest-380343807-project Oct 17 03:55:23.547489 dv-cinder-815582-16-smb devstack@n-api.service[125872]: method: > Oct 17 03:55:23.547489 dv-cinder-815582-16-smb devstack@n-api.service[125872]: exception: Instance 146a05a0-dc55-4c0d-804b-0577d163cacb could not be found. Oct 17 03:55:23.547489 dv-cinder-815582-16-smb devstack@n-api.service[125872]: action_args: {'id': '146a05a0-dc55-4c0d-804b-0577d163cacb'} Oct 17 03:55:23.548165 dv-cinder-815582-16-smb devstack@n-api.service[125872]: {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:55:23.548165 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:55:23.548165 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 03:55:23.548165 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 03:55:23.548165 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 03:55:23.548165 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 03:55:23.548165 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 03:55:23.548165 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 03:55:23.548165 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 03:55:23.548165 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 03:55:23.548165 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 146a05a0-dc55-4c0d-804b-0577d163cacb could not be found. Oct 17 03:55:23.548165 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:55:23.548165 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:55:23.548165 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:55:23.548165 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:55:23.548165 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:55:23.548165 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:55:23.548165 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:55:23.548165 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:55:23.548165 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:55:23.550275 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:55:23.550275 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 03:55:23.550275 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 03:55:23.550275 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 03:55:23.550275 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 03:55:23.550275 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 03:55:23.550275 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:55:23.550275 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 146a05a0-dc55-4c0d-804b-0577d163cacb could not be found. Oct 17 03:55:23.550275 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:55:23.550275 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:55:23.550275 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:55:23.550275 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:55:23.550275 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:55:23.550275 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:55:23.550275 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:55:23.550275 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:55:23.550275 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 146a05a0-dc55-4c0d-804b-0577d163cacb could not be found. Oct 17 03:55:23.550275 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:55:23.554916 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-554b370d-a0e0-4b8d-a21d-c08788d6332d tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] Returning 404 to user: Instance 146a05a0-dc55-4c0d-804b-0577d163cacb could not be found. {{(pid=125872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:55:23.554916 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-554b370d-a0e0-4b8d-a21d-c08788d6332d tempest-VolumesNegativeTest-380343807 tempest-VolumesNegativeTest-380343807-project] 10.222.0.16 "GET /compute/v2.1/servers/146a05a0-dc55-4c0d-804b-0577d163cacb" status: 404 len: 111 microversion: 2.1 time: 0.037443 Oct 17 03:55:23.554916 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 121/243] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:23 2022] GET /compute/v2.1/servers/146a05a0-dc55-4c0d-804b-0577d163cacb => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 03:55:23.822209 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-fe2b2447-bad6-4917-9ad9-77105be15ecc tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:23.823002 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-fe2b2447-bad6-4917-9ad9-77105be15ecc tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 06e9c5ca-8770-4ed5-90ae-bad248ab7ff7] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:23.830381 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-fe2b2447-bad6-4917-9ad9-77105be15ecc tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:23.830875 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-fe2b2447-bad6-4917-9ad9-77105be15ecc tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:23.831541 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-fe2b2447-bad6-4917-9ad9-77105be15ecc tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:23.831820 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [req-fa2d4ca2-b9c6-4568-a3c8-d22b798cb414 req-9901537a-3685-45f3-8559-200f585babb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0982f171-946d-4314-89f2-c139e6bf9adf", "tag": "8d6b4ea5-ab61-4510-be24-bef55f15afa4"}]} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:55:23.832606 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-fe2b2447-bad6-4917-9ad9-77105be15ecc tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:23.833416 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-fe2b2447-bad6-4917-9ad9-77105be15ecc tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:23.833854 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-fe2b2447-bad6-4917-9ad9-77105be15ecc tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:23.838467 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:55:23.841587 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-fa2d4ca2-b9c6-4568-a3c8-d22b798cb414 req-9901537a-3685-45f3-8559-200f585babb9 service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:23.842098 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-fa2d4ca2-b9c6-4568-a3c8-d22b798cb414 req-9901537a-3685-45f3-8559-200f585babb9 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:23.842553 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-fa2d4ca2-b9c6-4568-a3c8-d22b798cb414 req-9901537a-3685-45f3-8559-200f585babb9 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:23.854236 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.compute.server_external_events [req-fa2d4ca2-b9c6-4568-a3c8-d22b798cb414 req-9901537a-3685-45f3-8559-200f585babb9 service nova] Creating event network-changed:8d6b4ea5-ab61-4510-be24-bef55f15afa4 for instance 0982f171-946d-4314-89f2-c139e6bf9adf on hv-cinder-81558 Oct 17 03:55:23.859655 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [req-fa2d4ca2-b9c6-4568-a3c8-d22b798cb414 req-9901537a-3685-45f3-8559-200f585babb9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035050 Oct 17 03:55:23.860568 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 122/244] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 03:55:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:55:23.952849 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-c999b79b-83b7-49d5-8d49-125f7d61e1e6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:23.953689 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-c999b79b-83b7-49d5-8d49-125f7d61e1e6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:23.966919 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c999b79b-83b7-49d5-8d49-125f7d61e1e6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:23.974459 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c999b79b-83b7-49d5-8d49-125f7d61e1e6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:23.975833 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c999b79b-83b7-49d5-8d49-125f7d61e1e6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:23.976781 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c999b79b-83b7-49d5-8d49-125f7d61e1e6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:23.978101 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c999b79b-83b7-49d5-8d49-125f7d61e1e6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:23.978727 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c999b79b-83b7-49d5-8d49-125f7d61e1e6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:23.999651 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-fe2b2447-bad6-4917-9ad9-77105be15ecc tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:24.012086 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-fe2b2447-bad6-4917-9ad9-77105be15ecc tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7" status: 200 len: 1521 microversion: 2.1 time: 0.193909 Oct 17 03:55:24.012811 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 123/245] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:23 2022] GET /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:24.359090 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-c999b79b-83b7-49d5-8d49-125f7d61e1e6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:24.368701 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-c999b79b-83b7-49d5-8d49-125f7d61e1e6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:24.370182 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-c999b79b-83b7-49d5-8d49-125f7d61e1e6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:24.371356 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-c999b79b-83b7-49d5-8d49-125f7d61e1e6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1406 microversion: 2.20 time: 0.423312 Oct 17 03:55:24.372428 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 123/246] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:55:23 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1406 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:55:25.036582 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-7fcf5699-9568-4edf-ae47-d47637627032 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:25.037281 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-7fcf5699-9568-4edf-ae47-d47637627032 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 06e9c5ca-8770-4ed5-90ae-bad248ab7ff7] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:25.044554 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7fcf5699-9568-4edf-ae47-d47637627032 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:25.045046 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7fcf5699-9568-4edf-ae47-d47637627032 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:25.045486 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7fcf5699-9568-4edf-ae47-d47637627032 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:25.046184 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7fcf5699-9568-4edf-ae47-d47637627032 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:25.046640 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7fcf5699-9568-4edf-ae47-d47637627032 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:25.047072 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7fcf5699-9568-4edf-ae47-d47637627032 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:25.180666 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-7fcf5699-9568-4edf-ae47-d47637627032 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:25.188306 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-7fcf5699-9568-4edf-ae47-d47637627032 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7" status: 200 len: 1521 microversion: 2.1 time: 0.156875 Oct 17 03:55:25.189053 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 124/247] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:25 2022] GET /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:55:25.398574 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-034bad1e-05d9-4a11-97cb-805c0bf102a5 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:25.399218 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-034bad1e-05d9-4a11-97cb-805c0bf102a5 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:25.406466 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-034bad1e-05d9-4a11-97cb-805c0bf102a5 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:25.406945 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-034bad1e-05d9-4a11-97cb-805c0bf102a5 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:25.408258 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-034bad1e-05d9-4a11-97cb-805c0bf102a5 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:25.408948 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-034bad1e-05d9-4a11-97cb-805c0bf102a5 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:25.409398 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-034bad1e-05d9-4a11-97cb-805c0bf102a5 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:25.409904 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-034bad1e-05d9-4a11-97cb-805c0bf102a5 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:25.546039 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-034bad1e-05d9-4a11-97cb-805c0bf102a5 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:25.554629 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-034bad1e-05d9-4a11-97cb-805c0bf102a5 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:25.556957 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-034bad1e-05d9-4a11-97cb-805c0bf102a5 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:25.557168 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-034bad1e-05d9-4a11-97cb-805c0bf102a5 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1406 microversion: 2.20 time: 0.162579 Oct 17 03:55:25.574280 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 124/248] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:55:25 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:55:26.211773 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-df096b9a-a5e0-4667-9e89-cbebf98d787d tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:26.212420 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-df096b9a-a5e0-4667-9e89-cbebf98d787d tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 06e9c5ca-8770-4ed5-90ae-bad248ab7ff7] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:26.214231 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_cell0:SELECT=2 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:55:26.219498 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-df096b9a-a5e0-4667-9e89-cbebf98d787d tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:26.219984 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-df096b9a-a5e0-4667-9e89-cbebf98d787d tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:26.220419 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-df096b9a-a5e0-4667-9e89-cbebf98d787d tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:26.221114 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-df096b9a-a5e0-4667-9e89-cbebf98d787d tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:26.221637 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-df096b9a-a5e0-4667-9e89-cbebf98d787d tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:26.222067 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-df096b9a-a5e0-4667-9e89-cbebf98d787d tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:26.351161 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-df096b9a-a5e0-4667-9e89-cbebf98d787d tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:26.360223 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-df096b9a-a5e0-4667-9e89-cbebf98d787d tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7" status: 200 len: 1521 microversion: 2.1 time: 0.152676 Oct 17 03:55:26.360734 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 125/249] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:26 2022] GET /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:26.581811 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-f347696c-4ff4-48f4-8f6f-711c20159d19 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:26.582418 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-f347696c-4ff4-48f4-8f6f-711c20159d19 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:26.585496 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_cell0:SELECT=6 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:55:26.591817 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f347696c-4ff4-48f4-8f6f-711c20159d19 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:26.591817 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f347696c-4ff4-48f4-8f6f-711c20159d19 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:26.591817 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f347696c-4ff4-48f4-8f6f-711c20159d19 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:26.592193 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f347696c-4ff4-48f4-8f6f-711c20159d19 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:26.592280 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f347696c-4ff4-48f4-8f6f-711c20159d19 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:26.592701 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f347696c-4ff4-48f4-8f6f-711c20159d19 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:26.597107 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:55:26.732733 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-f347696c-4ff4-48f4-8f6f-711c20159d19 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:26.742034 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-f347696c-4ff4-48f4-8f6f-711c20159d19 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:26.743649 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-f347696c-4ff4-48f4-8f6f-711c20159d19 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:26.744985 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-f347696c-4ff4-48f4-8f6f-711c20159d19 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1406 microversion: 2.20 time: 0.167109 Oct 17 03:55:26.755596 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 125/250] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:55:26 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1406 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:55:27.383704 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-4450262a-dd1f-4335-b1a3-6f132ee0bc69 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:27.384345 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-4450262a-dd1f-4335-b1a3-6f132ee0bc69 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 06e9c5ca-8770-4ed5-90ae-bad248ab7ff7] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:27.388301 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_cell0:SELECT=8 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:55:27.394512 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-4450262a-dd1f-4335-b1a3-6f132ee0bc69 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:27.395000 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-4450262a-dd1f-4335-b1a3-6f132ee0bc69 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:27.400164 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-4450262a-dd1f-4335-b1a3-6f132ee0bc69 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:27.400164 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-4450262a-dd1f-4335-b1a3-6f132ee0bc69 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:27.400164 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-4450262a-dd1f-4335-b1a3-6f132ee0bc69 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:27.400164 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-4450262a-dd1f-4335-b1a3-6f132ee0bc69 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:27.576732 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-4450262a-dd1f-4335-b1a3-6f132ee0bc69 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:27.586881 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-4450262a-dd1f-4335-b1a3-6f132ee0bc69 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7" status: 200 len: 1521 microversion: 2.1 time: 0.207444 Oct 17 03:55:27.587688 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 126/251] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:27 2022] GET /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:27.775982 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-d36d4be2-31f9-4208-95e2-ffa92eecaedf tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:27.776597 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-d36d4be2-31f9-4208-95e2-ffa92eecaedf tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:27.784194 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d36d4be2-31f9-4208-95e2-ffa92eecaedf tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:27.784678 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d36d4be2-31f9-4208-95e2-ffa92eecaedf tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:27.785114 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d36d4be2-31f9-4208-95e2-ffa92eecaedf tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:27.785805 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d36d4be2-31f9-4208-95e2-ffa92eecaedf tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:27.786267 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d36d4be2-31f9-4208-95e2-ffa92eecaedf tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:27.792504 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d36d4be2-31f9-4208-95e2-ffa92eecaedf tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:28.081411 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-d36d4be2-31f9-4208-95e2-ffa92eecaedf tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:28.114790 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-d36d4be2-31f9-4208-95e2-ffa92eecaedf tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:28.117697 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-d36d4be2-31f9-4208-95e2-ffa92eecaedf tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:28.121865 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-d36d4be2-31f9-4208-95e2-ffa92eecaedf tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1406 microversion: 2.20 time: 0.350074 Oct 17 03:55:28.139644 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 126/252] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:55:27 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1406 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:55:28.615128 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-b861663e-e9bf-4d7b-8e3c-9935d9f21f8b tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:28.616221 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-b861663e-e9bf-4d7b-8e3c-9935d9f21f8b tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 06e9c5ca-8770-4ed5-90ae-bad248ab7ff7] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:28.630260 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b861663e-e9bf-4d7b-8e3c-9935d9f21f8b tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:28.631165 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b861663e-e9bf-4d7b-8e3c-9935d9f21f8b tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:28.632003 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b861663e-e9bf-4d7b-8e3c-9935d9f21f8b tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:28.633237 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b861663e-e9bf-4d7b-8e3c-9935d9f21f8b tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:28.634310 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b861663e-e9bf-4d7b-8e3c-9935d9f21f8b tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:28.636088 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b861663e-e9bf-4d7b-8e3c-9935d9f21f8b tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:28.890371 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-b861663e-e9bf-4d7b-8e3c-9935d9f21f8b tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:28.900509 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-b861663e-e9bf-4d7b-8e3c-9935d9f21f8b tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7" status: 200 len: 1521 microversion: 2.1 time: 0.293935 Oct 17 03:55:28.901294 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 127/253] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:28 2022] GET /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7 => generated 1521 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:28.930422 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-8a490c33-485d-432f-ae1c-6210c7fa3eba tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:28.931036 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-8a490c33-485d-432f-ae1c-6210c7fa3eba tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: ff49fd54-9ddf-415d-8eb4-fb1b0bef634c] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:28.938165 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8a490c33-485d-432f-ae1c-6210c7fa3eba tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:28.938647 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8a490c33-485d-432f-ae1c-6210c7fa3eba tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:28.939241 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8a490c33-485d-432f-ae1c-6210c7fa3eba tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:28.939857 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8a490c33-485d-432f-ae1c-6210c7fa3eba tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:28.940328 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8a490c33-485d-432f-ae1c-6210c7fa3eba tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:28.940738 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8a490c33-485d-432f-ae1c-6210c7fa3eba tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:28.964409 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-8a490c33-485d-432f-ae1c-6210c7fa3eba tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c/ips" status: 200 len: 151 microversion: 2.1 time: 0.038275 Oct 17 03:55:28.967926 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 127/254] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Oct 17 03:55:28 2022] GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:55:29.154670 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-92f55211-f7a4-42a1-879d-f6eac7105c8b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:29.155308 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-92f55211-f7a4-42a1-879d-f6eac7105c8b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:29.161437 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-92f55211-f7a4-42a1-879d-f6eac7105c8b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:29.162361 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-92f55211-f7a4-42a1-879d-f6eac7105c8b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:29.162974 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-92f55211-f7a4-42a1-879d-f6eac7105c8b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:29.163707 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-92f55211-f7a4-42a1-879d-f6eac7105c8b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:29.164212 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-92f55211-f7a4-42a1-879d-f6eac7105c8b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:29.164638 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-92f55211-f7a4-42a1-879d-f6eac7105c8b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:29.305657 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-92f55211-f7a4-42a1-879d-f6eac7105c8b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:29.315550 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-92f55211-f7a4-42a1-879d-f6eac7105c8b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:29.317014 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-92f55211-f7a4-42a1-879d-f6eac7105c8b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:29.318212 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-92f55211-f7a4-42a1-879d-f6eac7105c8b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1406 microversion: 2.20 time: 0.167491 Oct 17 03:55:29.322316 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 128/255] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:55:29 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:55:29.923940 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-5a2326ea-9013-46ed-9091-728c85416faa tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:29.924668 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-5a2326ea-9013-46ed-9091-728c85416faa tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 06e9c5ca-8770-4ed5-90ae-bad248ab7ff7] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:29.930655 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-5a2326ea-9013-46ed-9091-728c85416faa tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:29.931672 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-5a2326ea-9013-46ed-9091-728c85416faa tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:29.931672 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-5a2326ea-9013-46ed-9091-728c85416faa tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:29.932265 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-5a2326ea-9013-46ed-9091-728c85416faa tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:29.932724 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-5a2326ea-9013-46ed-9091-728c85416faa tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:29.933145 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-5a2326ea-9013-46ed-9091-728c85416faa tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:30.121203 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-5a2326ea-9013-46ed-9091-728c85416faa tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:30.129407 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-5a2326ea-9013-46ed-9091-728c85416faa tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7" status: 200 len: 1521 microversion: 2.1 time: 0.209733 Oct 17 03:55:30.129973 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 128/256] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:29 2022] GET /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7 => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:30.343680 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-788f1552-f68e-49e6-9cc5-b2b738ce68df tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:30.345156 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-788f1552-f68e-49e6-9cc5-b2b738ce68df tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:30.355389 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-788f1552-f68e-49e6-9cc5-b2b738ce68df tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:30.356124 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-788f1552-f68e-49e6-9cc5-b2b738ce68df tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:30.356707 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-788f1552-f68e-49e6-9cc5-b2b738ce68df tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:30.357417 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-788f1552-f68e-49e6-9cc5-b2b738ce68df tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:30.357868 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-788f1552-f68e-49e6-9cc5-b2b738ce68df tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:30.358376 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-788f1552-f68e-49e6-9cc5-b2b738ce68df tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:30.551839 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-788f1552-f68e-49e6-9cc5-b2b738ce68df tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:30.565244 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-788f1552-f68e-49e6-9cc5-b2b738ce68df tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:30.567602 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-788f1552-f68e-49e6-9cc5-b2b738ce68df tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:30.568501 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-788f1552-f68e-49e6-9cc5-b2b738ce68df tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1406 microversion: 2.20 time: 0.229352 Oct 17 03:55:30.569864 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 129/257] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:55:30 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1406 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:55:30.790487 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-1a9955f9-f460-486c-9cda-42f567b8df6a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b4dfc0cd-7015-4b84-b8f9-f29eef843f13"}} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:55:30.793521 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-1a9955f9-f460-486c-9cda-42f567b8df6a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: ff49fd54-9ddf-415d-8eb4-fb1b0bef634c] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:30.800966 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1a9955f9-f460-486c-9cda-42f567b8df6a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:30.801453 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1a9955f9-f460-486c-9cda-42f567b8df6a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:30.808115 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1a9955f9-f460-486c-9cda-42f567b8df6a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:30.808600 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [req-7a0c9ff1-c297-415d-94ce-6640fca0aba3 req-5c6f6632-0c4c-4c78-be87-daeeefb50390 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0982f171-946d-4314-89f2-c139e6bf9adf", "name": "network-vif-plugged", "status": "completed", "tag": "8d6b4ea5-ab61-4510-be24-bef55f15afa4"}]} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:55:30.813403 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1a9955f9-f460-486c-9cda-42f567b8df6a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:30.813897 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1a9955f9-f460-486c-9cda-42f567b8df6a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:30.814329 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1a9955f9-f460-486c-9cda-42f567b8df6a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:30.824492 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-7a0c9ff1-c297-415d-94ce-6640fca0aba3 req-5c6f6632-0c4c-4c78-be87-daeeefb50390 service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:30.825001 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-7a0c9ff1-c297-415d-94ce-6640fca0aba3 req-5c6f6632-0c4c-4c78-be87-daeeefb50390 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:30.825432 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-7a0c9ff1-c297-415d-94ce-6640fca0aba3 req-5c6f6632-0c4c-4c78-be87-daeeefb50390 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:30.850594 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.compute.server_external_events [req-7a0c9ff1-c297-415d-94ce-6640fca0aba3 req-5c6f6632-0c4c-4c78-be87-daeeefb50390 service nova] Creating event network-vif-plugged:8d6b4ea5-ab61-4510-be24-bef55f15afa4 for instance 0982f171-946d-4314-89f2-c139e6bf9adf on hv-cinder-81558 Oct 17 03:55:30.855751 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [req-7a0c9ff1-c297-415d-94ce-6640fca0aba3 req-5c6f6632-0c4c-4c78-be87-daeeefb50390 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052198 Oct 17 03:55:30.859320 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 130/258] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 03:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 03:55:31.173750 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-2aa535fb-2e94-418a-a7fe-84cb1ff211e9 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:31.175560 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-2aa535fb-2e94-418a-a7fe-84cb1ff211e9 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 06e9c5ca-8770-4ed5-90ae-bad248ab7ff7] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:31.196271 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2aa535fb-2e94-418a-a7fe-84cb1ff211e9 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:31.196271 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2aa535fb-2e94-418a-a7fe-84cb1ff211e9 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:31.196271 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2aa535fb-2e94-418a-a7fe-84cb1ff211e9 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:31.196271 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2aa535fb-2e94-418a-a7fe-84cb1ff211e9 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:31.196859 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2aa535fb-2e94-418a-a7fe-84cb1ff211e9 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:31.196859 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2aa535fb-2e94-418a-a7fe-84cb1ff211e9 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:31.358652 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-2aa535fb-2e94-418a-a7fe-84cb1ff211e9 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:31.366749 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-2aa535fb-2e94-418a-a7fe-84cb1ff211e9 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7" status: 200 len: 1521 microversion: 2.1 time: 0.212661 Oct 17 03:55:31.367475 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 131/259] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:31 2022] GET /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7 => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:55:31.594591 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-496a72a9-36be-41d0-b460-770ce0227340 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:31.595251 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-496a72a9-36be-41d0-b460-770ce0227340 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:31.601047 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-496a72a9-36be-41d0-b460-770ce0227340 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:31.601527 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-496a72a9-36be-41d0-b460-770ce0227340 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:31.601984 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-496a72a9-36be-41d0-b460-770ce0227340 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:31.602650 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-496a72a9-36be-41d0-b460-770ce0227340 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:31.603103 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-496a72a9-36be-41d0-b460-770ce0227340 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:31.603547 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-496a72a9-36be-41d0-b460-770ce0227340 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:31.656806 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-1a9955f9-f460-486c-9cda-42f567b8df6a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "POST /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.872875 Oct 17 03:55:31.663357 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 129/260] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Oct 17 03:55:30 2022] POST /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c/os-volume_attachments => generated 194 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:55:31.788028 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-496a72a9-36be-41d0-b460-770ce0227340 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:31.799030 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-496a72a9-36be-41d0-b460-770ce0227340 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:31.803101 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-496a72a9-36be-41d0-b460-770ce0227340 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:31.804877 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-496a72a9-36be-41d0-b460-770ce0227340 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1406 microversion: 2.20 time: 0.214513 Oct 17 03:55:31.806490 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 132/261] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:55:31 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1406 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:55:32.392837 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-fb9272de-8e6b-4b67-bf8f-1ce4bc2ad329 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:32.393985 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-fb9272de-8e6b-4b67-bf8f-1ce4bc2ad329 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 06e9c5ca-8770-4ed5-90ae-bad248ab7ff7] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:32.401167 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-fb9272de-8e6b-4b67-bf8f-1ce4bc2ad329 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:32.401836 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-fb9272de-8e6b-4b67-bf8f-1ce4bc2ad329 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:32.402562 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-fb9272de-8e6b-4b67-bf8f-1ce4bc2ad329 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:32.403283 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-fb9272de-8e6b-4b67-bf8f-1ce4bc2ad329 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:32.403961 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-fb9272de-8e6b-4b67-bf8f-1ce4bc2ad329 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:32.405244 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-fb9272de-8e6b-4b67-bf8f-1ce4bc2ad329 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:32.557300 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-fb9272de-8e6b-4b67-bf8f-1ce4bc2ad329 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:32.568996 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-fb9272de-8e6b-4b67-bf8f-1ce4bc2ad329 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7" status: 200 len: 1521 microversion: 2.1 time: 0.182422 Oct 17 03:55:32.569747 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 130/262] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:32 2022] GET /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:32.832108 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-67c6ea97-6d5e-4c2d-80a9-f21d5b523ba6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:32.832719 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-67c6ea97-6d5e-4c2d-80a9-f21d5b523ba6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:32.838643 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-67c6ea97-6d5e-4c2d-80a9-f21d5b523ba6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:32.839115 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-67c6ea97-6d5e-4c2d-80a9-f21d5b523ba6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:32.839578 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-67c6ea97-6d5e-4c2d-80a9-f21d5b523ba6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:32.840258 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-67c6ea97-6d5e-4c2d-80a9-f21d5b523ba6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:32.840704 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-67c6ea97-6d5e-4c2d-80a9-f21d5b523ba6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:32.841122 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-67c6ea97-6d5e-4c2d-80a9-f21d5b523ba6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:33.003586 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-67c6ea97-6d5e-4c2d-80a9-f21d5b523ba6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:33.017139 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-67c6ea97-6d5e-4c2d-80a9-f21d5b523ba6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:33.018955 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-67c6ea97-6d5e-4c2d-80a9-f21d5b523ba6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:33.020966 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-67c6ea97-6d5e-4c2d-80a9-f21d5b523ba6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1598 microversion: 2.20 time: 0.192584 Oct 17 03:55:33.021773 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 133/263] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:55:32 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1598 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:55:33.048578 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-37d8ce8b-3c61-4ec4-a4e8-d7eff0484f3b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:33.049138 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-37d8ce8b-3c61-4ec4-a4e8-d7eff0484f3b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:33.055129 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-37d8ce8b-3c61-4ec4-a4e8-d7eff0484f3b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:33.055669 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-37d8ce8b-3c61-4ec4-a4e8-d7eff0484f3b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:33.056119 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-37d8ce8b-3c61-4ec4-a4e8-d7eff0484f3b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:33.056924 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-37d8ce8b-3c61-4ec4-a4e8-d7eff0484f3b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:33.057470 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-37d8ce8b-3c61-4ec4-a4e8-d7eff0484f3b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:33.057990 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-37d8ce8b-3c61-4ec4-a4e8-d7eff0484f3b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:33.136699 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-37d8ce8b-3c61-4ec4-a4e8-d7eff0484f3b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.092099 Oct 17 03:55:33.137476 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 131/264] 10.222.0.16 () {60 vars in 1316 bytes} [Mon Oct 17 03:55:33 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 03:55:33.382656 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-f507bd74-6b8b-49bd-ae41-5f0e476b6480 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:33.383151 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-f507bd74-6b8b-49bd-ae41-5f0e476b6480 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:33.390035 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f507bd74-6b8b-49bd-ae41-5f0e476b6480 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:33.390441 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f507bd74-6b8b-49bd-ae41-5f0e476b6480 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:33.390883 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f507bd74-6b8b-49bd-ae41-5f0e476b6480 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:33.391601 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f507bd74-6b8b-49bd-ae41-5f0e476b6480 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:33.392053 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f507bd74-6b8b-49bd-ae41-5f0e476b6480 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:33.392476 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f507bd74-6b8b-49bd-ae41-5f0e476b6480 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:33.416093 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-f507bd74-6b8b-49bd-ae41-5f0e476b6480 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe/ips" status: 200 len: 147 microversion: 2.1 time: 0.037442 Oct 17 03:55:33.416664 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 134/265] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Oct 17 03:55:33 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe/ips => generated 147 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:55:33.594141 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-9cb12374-09bf-4f66-8050-882b6120fd95 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:33.594957 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-9cb12374-09bf-4f66-8050-882b6120fd95 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 06e9c5ca-8770-4ed5-90ae-bad248ab7ff7] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:33.602055 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-9cb12374-09bf-4f66-8050-882b6120fd95 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:33.602659 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-9cb12374-09bf-4f66-8050-882b6120fd95 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:33.603360 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-9cb12374-09bf-4f66-8050-882b6120fd95 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:33.604701 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-9cb12374-09bf-4f66-8050-882b6120fd95 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:33.605240 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-9cb12374-09bf-4f66-8050-882b6120fd95 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:33.606277 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-9cb12374-09bf-4f66-8050-882b6120fd95 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:33.934122 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-9cb12374-09bf-4f66-8050-882b6120fd95 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:33.964039 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-9cb12374-09bf-4f66-8050-882b6120fd95 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7" status: 200 len: 1521 microversion: 2.1 time: 0.374904 Oct 17 03:55:33.964629 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 132/266] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:33 2022] GET /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7 => generated 1521 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:34.542954 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [req-fc7177f4-bb09-4214-ab85-3a42a82be81e req-944804dd-22f9-49e0-be6c-5b63d6ba6c14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0982f171-946d-4314-89f2-c139e6bf9adf", "tag": "8d6b4ea5-ab61-4510-be24-bef55f15afa4"}]} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:55:34.565124 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-fc7177f4-bb09-4214-ab85-3a42a82be81e req-944804dd-22f9-49e0-be6c-5b63d6ba6c14 service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:34.566412 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-fc7177f4-bb09-4214-ab85-3a42a82be81e req-944804dd-22f9-49e0-be6c-5b63d6ba6c14 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:34.566852 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-fc7177f4-bb09-4214-ab85-3a42a82be81e req-944804dd-22f9-49e0-be6c-5b63d6ba6c14 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:34.581825 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.compute.server_external_events [req-fc7177f4-bb09-4214-ab85-3a42a82be81e req-944804dd-22f9-49e0-be6c-5b63d6ba6c14 service nova] Creating event network-changed:8d6b4ea5-ab61-4510-be24-bef55f15afa4 for instance 0982f171-946d-4314-89f2-c139e6bf9adf on hv-cinder-81558 Oct 17 03:55:34.588075 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [req-fc7177f4-bb09-4214-ab85-3a42a82be81e req-944804dd-22f9-49e0-be6c-5b63d6ba6c14 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064845 Oct 17 03:55:34.589241 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 135/267] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 03:55:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:55:34.991309 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-948b4eba-a809-4737-b052-8a77c346eb2d tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:34.999328 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-948b4eba-a809-4737-b052-8a77c346eb2d tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 06e9c5ca-8770-4ed5-90ae-bad248ab7ff7] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:35.006710 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-948b4eba-a809-4737-b052-8a77c346eb2d tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:35.009365 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-948b4eba-a809-4737-b052-8a77c346eb2d tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:35.011089 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-948b4eba-a809-4737-b052-8a77c346eb2d tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:35.012164 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-948b4eba-a809-4737-b052-8a77c346eb2d tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:35.014371 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-948b4eba-a809-4737-b052-8a77c346eb2d tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:35.014996 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-948b4eba-a809-4737-b052-8a77c346eb2d tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:35.350224 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-5bd7a4e5-f323-442a-8497-f3b8f3797dc1 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Action: 'create', calling method: .version_select at 0x7fd72a80e280>, body: {"keypair": {"name": "tempest-keypair-1013327654", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP4q2yOJZwNRCVi/4QqoQGq5JV0m9LiDt7SjC2/q9q1D9ZFTvNIxcrNCZhCtq59k5z3seZH+wQkgCatcry/v1Ov+eLjBXF5ePaUPpF1ik9ZF3A8n2enfCDn7BbIoZgnAGA=="}} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:55:35.370805 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.quota [None req-5bd7a4e5-f323-442a-8497-f3b8f3797dc1 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Getting quotas for project 8af3ce80f169473882a247ba78d3d6ef. Resources: {'key_pairs'} {{(pid=125871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 03:55:35.378812 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.quota [None req-5bd7a4e5-f323-442a-8497-f3b8f3797dc1 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Getting quotas for user e9ac14bb6ceb4d9a92a20938e9688bbd and project 8af3ce80f169473882a247ba78d3d6ef. Resources: {'key_pairs'} {{(pid=125871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 03:55:35.440213 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-948b4eba-a809-4737-b052-8a77c346eb2d tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:35.448389 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-948b4eba-a809-4737-b052-8a77c346eb2d tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7" status: 200 len: 1521 microversion: 2.1 time: 0.463784 Oct 17 03:55:35.449645 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 133/268] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:34 2022] GET /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7 => generated 1521 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:35.490673 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-5bd7a4e5-f323-442a-8497-f3b8f3797dc1 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.141948 Oct 17 03:55:35.493102 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 136/269] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 17 03:55:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:55:36.477261 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-0a60f18b-157c-4f57-a39c-84458b37922c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:36.478990 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-0a60f18b-157c-4f57-a39c-84458b37922c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 06e9c5ca-8770-4ed5-90ae-bad248ab7ff7] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:36.488189 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0a60f18b-157c-4f57-a39c-84458b37922c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:36.488916 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0a60f18b-157c-4f57-a39c-84458b37922c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:36.489498 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0a60f18b-157c-4f57-a39c-84458b37922c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:36.490358 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0a60f18b-157c-4f57-a39c-84458b37922c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:36.490961 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0a60f18b-157c-4f57-a39c-84458b37922c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:36.491554 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0a60f18b-157c-4f57-a39c-84458b37922c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:36.647927 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-0a60f18b-157c-4f57-a39c-84458b37922c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:36.656407 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-0a60f18b-157c-4f57-a39c-84458b37922c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7" status: 200 len: 1521 microversion: 2.1 time: 0.187628 Oct 17 03:55:36.656984 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 134/270] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:36 2022] GET /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:37.078317 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-8382a603-e89c-44bd-852e-51189407ce99 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce179add-8f5d-436e-b71f-6954b0ece0e4"}} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:55:37.081408 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-8382a603-e89c-44bd-852e-51189407ce99 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:37.088987 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8382a603-e89c-44bd-852e-51189407ce99 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:37.089605 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8382a603-e89c-44bd-852e-51189407ce99 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:37.090044 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8382a603-e89c-44bd-852e-51189407ce99 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:37.090796 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8382a603-e89c-44bd-852e-51189407ce99 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:37.091205 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8382a603-e89c-44bd-852e-51189407ce99 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:37.092333 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8382a603-e89c-44bd-852e-51189407ce99 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:37.679957 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-d8f187ea-9969-49e8-a112-af8569fdcf2b tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:37.680605 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-d8f187ea-9969-49e8-a112-af8569fdcf2b tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 06e9c5ca-8770-4ed5-90ae-bad248ab7ff7] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:37.688698 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d8f187ea-9969-49e8-a112-af8569fdcf2b tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:37.689194 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d8f187ea-9969-49e8-a112-af8569fdcf2b tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:37.690321 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d8f187ea-9969-49e8-a112-af8569fdcf2b tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:37.690321 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d8f187ea-9969-49e8-a112-af8569fdcf2b tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:37.690918 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d8f187ea-9969-49e8-a112-af8569fdcf2b tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:37.691374 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d8f187ea-9969-49e8-a112-af8569fdcf2b tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:37.827342 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-d8f187ea-9969-49e8-a112-af8569fdcf2b tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:37.835786 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-d8f187ea-9969-49e8-a112-af8569fdcf2b tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7" status: 200 len: 1521 microversion: 2.1 time: 0.159682 Oct 17 03:55:37.836798 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 135/271] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:37 2022] GET /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:55:38.215493 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-8382a603-e89c-44bd-852e-51189407ce99 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "POST /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.141241 Oct 17 03:55:38.216343 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 137/272] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Oct 17 03:55:37 2022] POST /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe/os-volume_attachments => generated 194 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:55:38.403264 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-e3867f82-ef5d-4d4f-b881-3756ce0449e5 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1914654103", "imageRef": "add1979e-0a3b-4403-a8ae-8d9a7b045fc2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "08dcfdbc-aaeb-49ae-86ff-471831242857"}], "security_groups": [{"name": "tempest-securitygroup--734995690"}], "key_name": "tempest-keypair-1013327654", "user_data": "}} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:55:38.573651 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.network.neutron [None req-e3867f82-ef5d-4d4f-b881-3756ce0449e5 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] validate_networks() for [('08dcfdbc-aaeb-49ae-86ff-471831242857', None, None, None, None, None)] {{(pid=125872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 03:55:38.860608 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-c392edb6-66e6-4c40-825d-24387eced5bd tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:38.861630 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-c392edb6-66e6-4c40-825d-24387eced5bd tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 06e9c5ca-8770-4ed5-90ae-bad248ab7ff7] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:38.869144 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c392edb6-66e6-4c40-825d-24387eced5bd tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:38.869996 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c392edb6-66e6-4c40-825d-24387eced5bd tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:38.870623 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c392edb6-66e6-4c40-825d-24387eced5bd tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:38.871517 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c392edb6-66e6-4c40-825d-24387eced5bd tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:38.872147 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c392edb6-66e6-4c40-825d-24387eced5bd tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:38.872725 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c392edb6-66e6-4c40-825d-24387eced5bd tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:39.023113 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-c392edb6-66e6-4c40-825d-24387eced5bd tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:39.032693 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-c392edb6-66e6-4c40-825d-24387eced5bd tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7" status: 200 len: 1521 microversion: 2.1 time: 0.177130 Oct 17 03:55:39.034280 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 138/273] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:38 2022] GET /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:39.077180 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.virt.hardware [None req-e3867f82-ef5d-4d4f-b881-3756ce0449e5 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Flavor limits 0:0:0 {{(pid=125872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 03:55:39.078877 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.virt.hardware [None req-e3867f82-ef5d-4d4f-b881-3756ce0449e5 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Image limits 0:0:0 {{(pid=125872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 03:55:39.079737 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.virt.hardware [None req-e3867f82-ef5d-4d4f-b881-3756ce0449e5 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Flavor pref 0:0:0 {{(pid=125872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 03:55:39.082272 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.virt.hardware [None req-e3867f82-ef5d-4d4f-b881-3756ce0449e5 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Image pref 0:0:0 {{(pid=125872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 03:55:39.082272 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.virt.hardware [None req-e3867f82-ef5d-4d4f-b881-3756ce0449e5 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 03:55:39.092427 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e3867f82-ef5d-4d4f-b881-3756ce0449e5 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:39.093412 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e3867f82-ef5d-4d4f-b881-3756ce0449e5 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:39.094166 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e3867f82-ef5d-4d4f-b881-3756ce0449e5 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:39.094968 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e3867f82-ef5d-4d4f-b881-3756ce0449e5 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:39.095464 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e3867f82-ef5d-4d4f-b881-3756ce0449e5 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:39.095900 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e3867f82-ef5d-4d4f-b881-3756ce0449e5 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:39.116200 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.quota [None req-e3867f82-ef5d-4d4f-b881-3756ce0449e5 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Getting quotas for project 8af3ce80f169473882a247ba78d3d6ef. Resources: {'cores', 'instances', 'ram'} {{(pid=125872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 03:55:39.122568 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.quota [None req-e3867f82-ef5d-4d4f-b881-3756ce0449e5 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Getting quotas for user e9ac14bb6ceb4d9a92a20938e9688bbd and project 8af3ce80f169473882a247ba78d3d6ef. Resources: {'cores', 'instances', 'ram'} {{(pid=125872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 03:55:39.134640 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-e3867f82-ef5d-4d4f-b881-3756ce0449e5 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Going to run 1 instances... {{(pid=125872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 03:55:39.137254 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-e3867f82-ef5d-4d4f-b881-3756ce0449e5 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 44d8e487-b994-45ac-b2e4-47a6b7d425fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='add1979e-0a3b-4403-a8ae-8d9a7b045fc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 03:55:39.168757 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:55:39.251391 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-e3867f82-ef5d-4d4f-b881-3756ce0449e5 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.852573 Oct 17 03:55:39.252057 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 136/274] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 17 03:55:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 854 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 03:55:39.265446 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-aad16e78-fdbc-4e1b-b6a2-912fb661c659 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:39.266102 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-aad16e78-fdbc-4e1b-b6a2-912fb661c659 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 44d8e487-b994-45ac-b2e4-47a6b7d425fe] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:39.356356 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-aad16e78-fdbc-4e1b-b6a2-912fb661c659 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:39.369017 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-aad16e78-fdbc-4e1b-b6a2-912fb661c659 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/44d8e487-b994-45ac-b2e4-47a6b7d425fe" status: 200 len: 1242 microversion: 2.1 time: 0.109236 Oct 17 03:55:39.370554 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 139/275] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:39 2022] GET /compute/v2.1/servers/44d8e487-b994-45ac-b2e4-47a6b7d425fe => generated 1242 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:40.057723 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-c58e193b-067a-4913-9f3f-311db8992dfd tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:40.058430 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-c58e193b-067a-4913-9f3f-311db8992dfd tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 06e9c5ca-8770-4ed5-90ae-bad248ab7ff7] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:40.071061 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c58e193b-067a-4913-9f3f-311db8992dfd tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:40.071600 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c58e193b-067a-4913-9f3f-311db8992dfd tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:40.072007 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c58e193b-067a-4913-9f3f-311db8992dfd tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:40.072770 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c58e193b-067a-4913-9f3f-311db8992dfd tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:40.073224 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c58e193b-067a-4913-9f3f-311db8992dfd tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:40.073646 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c58e193b-067a-4913-9f3f-311db8992dfd tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:40.237713 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-c58e193b-067a-4913-9f3f-311db8992dfd tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:40.249439 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-c58e193b-067a-4913-9f3f-311db8992dfd tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7" status: 200 len: 1521 microversion: 2.1 time: 0.195932 Oct 17 03:55:40.250019 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 137/276] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:40 2022] GET /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:40.394535 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-54e2d0df-15a9-4bec-9292-5d942a66d8c6 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:40.395185 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-54e2d0df-15a9-4bec-9292-5d942a66d8c6 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 44d8e487-b994-45ac-b2e4-47a6b7d425fe] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:40.406535 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-54e2d0df-15a9-4bec-9292-5d942a66d8c6 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:40.407069 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-54e2d0df-15a9-4bec-9292-5d942a66d8c6 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:40.407483 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-54e2d0df-15a9-4bec-9292-5d942a66d8c6 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:40.410664 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-54e2d0df-15a9-4bec-9292-5d942a66d8c6 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:40.412205 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-54e2d0df-15a9-4bec-9292-5d942a66d8c6 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:40.412816 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-54e2d0df-15a9-4bec-9292-5d942a66d8c6 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:40.539306 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-54e2d0df-15a9-4bec-9292-5d942a66d8c6 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:40.546984 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-54e2d0df-15a9-4bec-9292-5d942a66d8c6 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/44d8e487-b994-45ac-b2e4-47a6b7d425fe" status: 200 len: 1246 microversion: 2.1 time: 0.156314 Oct 17 03:55:40.557469 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 140/277] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:40 2022] GET /compute/v2.1/servers/44d8e487-b994-45ac-b2e4-47a6b7d425fe => generated 1246 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:41.274297 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-d4f9a314-b1b4-4f10-aae8-104440a95124 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:41.275084 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-d4f9a314-b1b4-4f10-aae8-104440a95124 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 06e9c5ca-8770-4ed5-90ae-bad248ab7ff7] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:41.282906 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d4f9a314-b1b4-4f10-aae8-104440a95124 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:41.283447 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d4f9a314-b1b4-4f10-aae8-104440a95124 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:41.283924 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d4f9a314-b1b4-4f10-aae8-104440a95124 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:41.284631 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d4f9a314-b1b4-4f10-aae8-104440a95124 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:41.285091 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d4f9a314-b1b4-4f10-aae8-104440a95124 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:41.289340 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d4f9a314-b1b4-4f10-aae8-104440a95124 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:41.424971 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-d4f9a314-b1b4-4f10-aae8-104440a95124 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:41.432883 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-d4f9a314-b1b4-4f10-aae8-104440a95124 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7" status: 200 len: 1521 microversion: 2.1 time: 0.163762 Oct 17 03:55:41.433470 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 138/278] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:41 2022] GET /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:41.572069 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-46c4d9f1-a032-4c49-b659-390c71549003 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:41.572697 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-46c4d9f1-a032-4c49-b659-390c71549003 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 44d8e487-b994-45ac-b2e4-47a6b7d425fe] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:41.583553 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-46c4d9f1-a032-4c49-b659-390c71549003 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:41.585705 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-46c4d9f1-a032-4c49-b659-390c71549003 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:41.586351 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-46c4d9f1-a032-4c49-b659-390c71549003 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:41.589560 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-46c4d9f1-a032-4c49-b659-390c71549003 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:41.590225 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-46c4d9f1-a032-4c49-b659-390c71549003 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:41.594704 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-46c4d9f1-a032-4c49-b659-390c71549003 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:41.702113 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-46c4d9f1-a032-4c49-b659-390c71549003 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:41.704466 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-fa81d1a4-c112-4917-9378-c132dbf335fb tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:55:41.710606 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-46c4d9f1-a032-4c49-b659-390c71549003 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/44d8e487-b994-45ac-b2e4-47a6b7d425fe" status: 200 len: 1294 microversion: 2.1 time: 0.142349 Oct 17 03:55:41.711983 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 141/279] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:41 2022] GET /compute/v2.1/servers/44d8e487-b994-45ac-b2e4-47a6b7d425fe => generated 1294 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:41.713565 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-fa81d1a4-c112-4917-9378-c132dbf335fb tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:41.719075 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-fa81d1a4-c112-4917-9378-c132dbf335fb tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:41.719075 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-fa81d1a4-c112-4917-9378-c132dbf335fb tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:41.793257 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-fa81d1a4-c112-4917-9378-c132dbf335fb tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Going to try to stop instance {{(pid=125872) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 17 03:55:41.975195 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-fa81d1a4-c112-4917-9378-c132dbf335fb tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "POST /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe/action" status: 202 len: 0 microversion: 2.1 time: 0.276724 Oct 17 03:55:41.975948 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 139/280] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 17 03:55:41 2022] POST /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe/action => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 03:55:41.984958 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-23d00962-9e32-458e-8cfa-3b6c620b491b tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:41.985576 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-23d00962-9e32-458e-8cfa-3b6c620b491b tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:41.993003 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-23d00962-9e32-458e-8cfa-3b6c620b491b tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:41.993548 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-23d00962-9e32-458e-8cfa-3b6c620b491b tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:41.993975 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-23d00962-9e32-458e-8cfa-3b6c620b491b tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:41.994703 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-23d00962-9e32-458e-8cfa-3b6c620b491b tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:41.995376 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-23d00962-9e32-458e-8cfa-3b6c620b491b tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:41.995808 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-23d00962-9e32-458e-8cfa-3b6c620b491b tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:42.000631 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:55:42.148918 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-23d00962-9e32-458e-8cfa-3b6c620b491b tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:42.163331 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-23d00962-9e32-458e-8cfa-3b6c620b491b tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1724 microversion: 2.1 time: 0.182838 Oct 17 03:55:42.163925 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 142/281] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:41 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:55:42.458695 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-de5744b5-22a8-44b9-9f65-bd1e4ddd6232 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:42.459433 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-de5744b5-22a8-44b9-9f65-bd1e4ddd6232 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 06e9c5ca-8770-4ed5-90ae-bad248ab7ff7] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:42.466112 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-de5744b5-22a8-44b9-9f65-bd1e4ddd6232 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:42.467307 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-de5744b5-22a8-44b9-9f65-bd1e4ddd6232 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:42.467747 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-de5744b5-22a8-44b9-9f65-bd1e4ddd6232 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:42.468458 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-de5744b5-22a8-44b9-9f65-bd1e4ddd6232 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:42.468896 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-de5744b5-22a8-44b9-9f65-bd1e4ddd6232 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:42.469320 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-de5744b5-22a8-44b9-9f65-bd1e4ddd6232 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:42.686295 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-de5744b5-22a8-44b9-9f65-bd1e4ddd6232 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:42.690631 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:55:42.695468 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-de5744b5-22a8-44b9-9f65-bd1e4ddd6232 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7" status: 200 len: 1521 microversion: 2.1 time: 0.241831 Oct 17 03:55:42.696064 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 140/282] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:42 2022] GET /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7 => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:42.741576 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-45cf7e0a-f725-40c2-b122-3a6de828d1ff tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:42.742703 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-45cf7e0a-f725-40c2-b122-3a6de828d1ff tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 44d8e487-b994-45ac-b2e4-47a6b7d425fe] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:42.751144 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-45cf7e0a-f725-40c2-b122-3a6de828d1ff tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:42.751668 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-45cf7e0a-f725-40c2-b122-3a6de828d1ff tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:42.752563 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-45cf7e0a-f725-40c2-b122-3a6de828d1ff tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:42.753319 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-45cf7e0a-f725-40c2-b122-3a6de828d1ff tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:42.753818 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-45cf7e0a-f725-40c2-b122-3a6de828d1ff tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:42.754358 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-45cf7e0a-f725-40c2-b122-3a6de828d1ff tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:42.824211 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-45cf7e0a-f725-40c2-b122-3a6de828d1ff tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:42.834417 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-45cf7e0a-f725-40c2-b122-3a6de828d1ff tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/44d8e487-b994-45ac-b2e4-47a6b7d425fe" status: 200 len: 1294 microversion: 2.1 time: 0.097265 Oct 17 03:55:42.835803 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 143/283] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:42 2022] GET /compute/v2.1/servers/44d8e487-b994-45ac-b2e4-47a6b7d425fe => generated 1294 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:43.195238 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-fff92ede-7d4f-45f2-8183-addfdbd1a5b2 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:43.200441 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-fff92ede-7d4f-45f2-8183-addfdbd1a5b2 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:43.219152 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-fff92ede-7d4f-45f2-8183-addfdbd1a5b2 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:43.219680 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-fff92ede-7d4f-45f2-8183-addfdbd1a5b2 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:43.220127 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-fff92ede-7d4f-45f2-8183-addfdbd1a5b2 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:43.223102 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-fff92ede-7d4f-45f2-8183-addfdbd1a5b2 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:43.223622 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-fff92ede-7d4f-45f2-8183-addfdbd1a5b2 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:43.224076 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-fff92ede-7d4f-45f2-8183-addfdbd1a5b2 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:43.496617 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-fff92ede-7d4f-45f2-8183-addfdbd1a5b2 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:43.505833 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-fff92ede-7d4f-45f2-8183-addfdbd1a5b2 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1724 microversion: 2.1 time: 0.316688 Oct 17 03:55:43.506420 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 141/284] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:43 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1724 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:43.721951 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-59eae841-a87c-4458-9909-6249395d2d12 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:43.722584 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-59eae841-a87c-4458-9909-6249395d2d12 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 06e9c5ca-8770-4ed5-90ae-bad248ab7ff7] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:43.739858 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-59eae841-a87c-4458-9909-6249395d2d12 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:43.740440 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-59eae841-a87c-4458-9909-6249395d2d12 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:43.740948 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-59eae841-a87c-4458-9909-6249395d2d12 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:43.741770 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-59eae841-a87c-4458-9909-6249395d2d12 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:43.751776 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-59eae841-a87c-4458-9909-6249395d2d12 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:43.751776 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-59eae841-a87c-4458-9909-6249395d2d12 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:43.864850 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-0b7d80d5-88d2-4db2-a68a-8550fe53e63b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:43.865724 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-0b7d80d5-88d2-4db2-a68a-8550fe53e63b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 44d8e487-b994-45ac-b2e4-47a6b7d425fe] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:43.873006 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0b7d80d5-88d2-4db2-a68a-8550fe53e63b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:43.873762 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0b7d80d5-88d2-4db2-a68a-8550fe53e63b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:43.874265 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0b7d80d5-88d2-4db2-a68a-8550fe53e63b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:43.875032 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0b7d80d5-88d2-4db2-a68a-8550fe53e63b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:43.875723 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0b7d80d5-88d2-4db2-a68a-8550fe53e63b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:43.876218 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0b7d80d5-88d2-4db2-a68a-8550fe53e63b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:43.983161 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-0b7d80d5-88d2-4db2-a68a-8550fe53e63b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:44.006012 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-0b7d80d5-88d2-4db2-a68a-8550fe53e63b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/44d8e487-b994-45ac-b2e4-47a6b7d425fe" status: 200 len: 1300 microversion: 2.1 time: 0.144975 Oct 17 03:55:44.015208 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 142/285] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:43 2022] GET /compute/v2.1/servers/44d8e487-b994-45ac-b2e4-47a6b7d425fe => generated 1300 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:55:44.023208 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-59eae841-a87c-4458-9909-6249395d2d12 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:44.032105 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-59eae841-a87c-4458-9909-6249395d2d12 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7" status: 200 len: 1501 microversion: 2.1 time: 0.314641 Oct 17 03:55:44.034478 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 144/286] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:43 2022] GET /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7 => generated 1501 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:44.056842 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-0737684b-c864-4c4f-a1fa-1b51c5752252 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4a75d4c8-0e0f-4283-b49b-344cbd7a124f"}} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:55:44.059317 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-0737684b-c864-4c4f-a1fa-1b51c5752252 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 06e9c5ca-8770-4ed5-90ae-bad248ab7ff7] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:44.065630 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0737684b-c864-4c4f-a1fa-1b51c5752252 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:44.066124 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0737684b-c864-4c4f-a1fa-1b51c5752252 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:44.066687 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0737684b-c864-4c4f-a1fa-1b51c5752252 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:44.067547 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0737684b-c864-4c4f-a1fa-1b51c5752252 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:44.068198 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0737684b-c864-4c4f-a1fa-1b51c5752252 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:44.068642 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0737684b-c864-4c4f-a1fa-1b51c5752252 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:44.096992 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.wsgi [None req-0737684b-c864-4c4f-a1fa-1b51c5752252 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] HTTP exception thrown: Cannot 'attach_volume' instance 06e9c5ca-8770-4ed5-90ae-bad248ab7ff7 while it is in vm_state rescued Oct 17 03:55:44.098674 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-0737684b-c864-4c4f-a1fa-1b51c5752252 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Request method failure captured: Oct 17 03:55:44.098674 dv-cinder-815582-16-smb devstack@n-api.service[125872]: request: POST /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7/os-volume_attachments HTTP/1.1 Oct 17 03:55:44.098674 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Accept: application/json Oct 17 03:55:44.098674 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Accept-Encoding: identity Oct 17 03:55:44.098674 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Connection: close Oct 17 03:55:44.098674 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Content-Length: 74 Oct 17 03:55:44.098674 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Content-Type: application/json Oct 17 03:55:44.098674 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Host: 10.222.0.16 Oct 17 03:55:44.098674 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Openstack-System-Scope: None Oct 17 03:55:44.098674 dv-cinder-815582-16-smb devstack@n-api.service[125872]: User-Agent: python-urllib3/1.26.12 Oct 17 03:55:44.098674 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Auth-Token: gAAAAABjTNHYLxUsgcq_ACPqiARQRHFZX3xLv8SayCvNAWGNHgFQpkcgEDanwG27BF2rHPhh0X13DIu7TiIER2OGNrGDta7scBiyr4QHstEFtiE-NGtlSlpYsVJP4E4zCTmikL_tTbEERMy_oJ_SGh8iD1-z3BXcak8DQ79G1K_sLtgABtxSp2A Oct 17 03:55:44.098674 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Domain-Id: None Oct 17 03:55:44.098674 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Domain-Name: None Oct 17 03:55:44.098674 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Identity-Status: Confirmed Oct 17 03:55:44.098674 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Is-Admin-Project: True Oct 17 03:55:44.098674 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Domain-Id: default Oct 17 03:55:44.098674 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Domain-Name: Default Oct 17 03:55:44.098674 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Id: b033d35610f34401a99b912f145eb317 Oct 17 03:55:44.098674 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-464495139 Oct 17 03:55:44.098674 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Role: reader,member Oct 17 03:55:44.098674 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Roles: reader,member Oct 17 03:55:44.100555 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b033d35610f34401a99b912f145eb317"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b033d35610f34401a99b912f145eb317"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b033d35610f34401a99b912f145eb317"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b033d35610f34401a99b912f145eb317", "adminURL": "http://10.222.0.16:8080"}]}] Oct 17 03:55:44.100555 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant: tempest-ServerRescueNegativeTestJSON-464495139 Oct 17 03:55:44.100555 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant-Id: b033d35610f34401a99b912f145eb317 Oct 17 03:55:44.100555 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-464495139 Oct 17 03:55:44.100555 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User: tempest-ServerRescueNegativeTestJSON-464495139-project Oct 17 03:55:44.100555 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Domain-Id: default Oct 17 03:55:44.100555 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Domain-Name: Default Oct 17 03:55:44.100555 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Id: fa0a6947667d48bfabf6aefad09c8325 Oct 17 03:55:44.100555 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Name: tempest-ServerRescueNegativeTestJSON-464495139-project Oct 17 03:55:44.100555 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Oct 17 03:55:44.100555 dv-cinder-815582-16-smb devstack@n-api.service[125872]: {"volumeAttachment": {"volumeId": "4a75d4c8-0e0f-4283-b49b-344cbd7a124f"}} Oct 17 03:55:44.100555 dv-cinder-815582-16-smb devstack@n-api.service[125872]: method: > Oct 17 03:55:44.101625 dv-cinder-815582-16-smb devstack@n-api.service[125872]: exception: Cannot 'attach_volume' instance 06e9c5ca-8770-4ed5-90ae-bad248ab7ff7 while it is in vm_state rescued Oct 17 03:55:44.101625 dv-cinder-815582-16-smb devstack@n-api.service[125872]: action_args: {'server_id': '06e9c5ca-8770-4ed5-90ae-bad248ab7ff7', 'body': {'volumeAttachment': {'volumeId': '4a75d4c8-0e0f-4283-b49b-344cbd7a124f'}}} Oct 17 03:55:44.101625 dv-cinder-815582-16-smb devstack@n-api.service[125872]: {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:55:44.101625 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:55:44.101625 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 17 03:55:44.101625 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 17 03:55:44.101625 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 03:55:44.101625 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 03:55:44.101625 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 17 03:55:44.101625 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 03:55:44.101625 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 06e9c5ca-8770-4ed5-90ae-bad248ab7ff7 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 17 03:55:44.101625 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:55:44.101625 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:55:44.101625 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:55:44.101625 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:55:44.101625 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:55:44.101625 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:55:44.101625 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:55:44.101625 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:55:44.102729 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:55:44.102729 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:55:44.102729 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 03:55:44.102729 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 03:55:44.102729 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 03:55:44.102729 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 03:55:44.102729 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 03:55:44.102729 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 03:55:44.102729 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 17 03:55:44.102729 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 17 03:55:44.102729 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 03:55:44.102729 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 03:55:44.102729 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 06e9c5ca-8770-4ed5-90ae-bad248ab7ff7 while it is in vm_state rescued Oct 17 03:55:44.102729 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:55:44.102729 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:55:44.102729 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:55:44.102729 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:55:44.102729 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:55:44.102729 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:55:44.105050 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:55:44.105050 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:55:44.105050 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 06e9c5ca-8770-4ed5-90ae-bad248ab7ff7 while it is in vm_state rescued Oct 17 03:55:44.105050 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:55:44.105050 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-0737684b-c864-4c4f-a1fa-1b51c5752252 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Returning 409 to user: Cannot 'attach_volume' instance 06e9c5ca-8770-4ed5-90ae-bad248ab7ff7 while it is in vm_state rescued {{(pid=125872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:55:44.105050 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-0737684b-c864-4c4f-a1fa-1b51c5752252 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "POST /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.047424 Oct 17 03:55:44.105050 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 143/287] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Oct 17 03:55:44 2022] POST /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7/os-volume_attachments => generated 152 bytes in 49 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 03:55:44.110300 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-10bb600a-9162-493b-9a0c-9bfa7a8bebd8 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:55:44.110879 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-10bb600a-9162-493b-9a0c-9bfa7a8bebd8 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 06e9c5ca-8770-4ed5-90ae-bad248ab7ff7] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:44.118350 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-10bb600a-9162-493b-9a0c-9bfa7a8bebd8 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:44.118350 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-10bb600a-9162-493b-9a0c-9bfa7a8bebd8 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:44.118912 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-10bb600a-9162-493b-9a0c-9bfa7a8bebd8 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:44.120801 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-10bb600a-9162-493b-9a0c-9bfa7a8bebd8 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:44.121414 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-10bb600a-9162-493b-9a0c-9bfa7a8bebd8 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:44.121973 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-10bb600a-9162-493b-9a0c-9bfa7a8bebd8 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:44.446615 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-10bb600a-9162-493b-9a0c-9bfa7a8bebd8 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "POST /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7/action" status: 202 len: 0 microversion: 2.1 time: 0.336900 Oct 17 03:55:44.446615 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 145/288] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 17 03:55:44 2022] POST /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7/action => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 03:55:44.453987 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-91d8ffb3-0af5-4882-b4a2-9dbe5f4441ba tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:44.454768 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-91d8ffb3-0af5-4882-b4a2-9dbe5f4441ba tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 06e9c5ca-8770-4ed5-90ae-bad248ab7ff7] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:44.468769 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-91d8ffb3-0af5-4882-b4a2-9dbe5f4441ba tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:44.469268 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-91d8ffb3-0af5-4882-b4a2-9dbe5f4441ba tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:44.469702 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-91d8ffb3-0af5-4882-b4a2-9dbe5f4441ba tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:44.470417 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-91d8ffb3-0af5-4882-b4a2-9dbe5f4441ba tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:44.470875 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-91d8ffb3-0af5-4882-b4a2-9dbe5f4441ba tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:44.471329 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-91d8ffb3-0af5-4882-b4a2-9dbe5f4441ba tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:44.530685 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-b09b27c7-e036-4d05-80e2-13f58f67908a tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:44.531498 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-b09b27c7-e036-4d05-80e2-13f58f67908a tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:44.538672 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b09b27c7-e036-4d05-80e2-13f58f67908a tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:44.539212 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b09b27c7-e036-4d05-80e2-13f58f67908a tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:44.539641 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b09b27c7-e036-4d05-80e2-13f58f67908a tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:44.540350 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b09b27c7-e036-4d05-80e2-13f58f67908a tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:44.540912 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b09b27c7-e036-4d05-80e2-13f58f67908a tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:44.541341 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b09b27c7-e036-4d05-80e2-13f58f67908a tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:44.812225 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-91d8ffb3-0af5-4882-b4a2-9dbe5f4441ba tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:44.820814 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-91d8ffb3-0af5-4882-b4a2-9dbe5f4441ba tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7" status: 200 len: 1509 microversion: 2.1 time: 0.371878 Oct 17 03:55:44.821398 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 144/289] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:44 2022] GET /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7 => generated 1509 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:45.041564 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-0cba677a-d9a7-4284-9811-16cb1e57908d tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:45.042326 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-0cba677a-d9a7-4284-9811-16cb1e57908d tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 44d8e487-b994-45ac-b2e4-47a6b7d425fe] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:45.049135 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0cba677a-d9a7-4284-9811-16cb1e57908d tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:45.049860 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0cba677a-d9a7-4284-9811-16cb1e57908d tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:45.050303 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0cba677a-d9a7-4284-9811-16cb1e57908d tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:45.051130 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0cba677a-d9a7-4284-9811-16cb1e57908d tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:45.051603 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0cba677a-d9a7-4284-9811-16cb1e57908d tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:45.052017 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0cba677a-d9a7-4284-9811-16cb1e57908d tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:45.281980 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-b09b27c7-e036-4d05-80e2-13f58f67908a tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:45.296866 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-b09b27c7-e036-4d05-80e2-13f58f67908a tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1724 microversion: 2.1 time: 0.770498 Oct 17 03:55:45.306182 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 146/290] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:44 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1724 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:45.448369 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-0cba677a-d9a7-4284-9811-16cb1e57908d tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:45.457177 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-0cba677a-d9a7-4284-9811-16cb1e57908d tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/44d8e487-b994-45ac-b2e4-47a6b7d425fe" status: 200 len: 1367 microversion: 2.1 time: 0.419749 Oct 17 03:55:45.458231 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 145/291] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:45 2022] GET /compute/v2.1/servers/44d8e487-b994-45ac-b2e4-47a6b7d425fe => generated 1367 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:55:45.855093 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-2cd7105f-3fa6-4f6e-ac01-96ba5bf3e747 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:45.858509 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-2cd7105f-3fa6-4f6e-ac01-96ba5bf3e747 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 06e9c5ca-8770-4ed5-90ae-bad248ab7ff7] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:45.891400 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2cd7105f-3fa6-4f6e-ac01-96ba5bf3e747 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:45.892540 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2cd7105f-3fa6-4f6e-ac01-96ba5bf3e747 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:45.893363 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2cd7105f-3fa6-4f6e-ac01-96ba5bf3e747 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:45.894992 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2cd7105f-3fa6-4f6e-ac01-96ba5bf3e747 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:45.895432 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2cd7105f-3fa6-4f6e-ac01-96ba5bf3e747 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:45.895875 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2cd7105f-3fa6-4f6e-ac01-96ba5bf3e747 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:46.121960 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [req-3c5513b9-b4ea-4ba2-b89e-9273fcde292a req-4cf04d6d-6383-45e0-9dc6-c0a8e1ade949 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44d8e487-b994-45ac-b2e4-47a6b7d425fe", "tag": "29b0d627-a2ca-49fa-8220-6e478eea9d13"}]} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:55:46.132821 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-3c5513b9-b4ea-4ba2-b89e-9273fcde292a req-4cf04d6d-6383-45e0-9dc6-c0a8e1ade949 service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:46.133302 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-3c5513b9-b4ea-4ba2-b89e-9273fcde292a req-4cf04d6d-6383-45e0-9dc6-c0a8e1ade949 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:46.133735 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-3c5513b9-b4ea-4ba2-b89e-9273fcde292a req-4cf04d6d-6383-45e0-9dc6-c0a8e1ade949 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:46.145793 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.compute.server_external_events [req-3c5513b9-b4ea-4ba2-b89e-9273fcde292a req-4cf04d6d-6383-45e0-9dc6-c0a8e1ade949 service nova] Creating event network-changed:29b0d627-a2ca-49fa-8220-6e478eea9d13 for instance 44d8e487-b994-45ac-b2e4-47a6b7d425fe on hv-cinder-81558 Oct 17 03:55:46.151530 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [req-3c5513b9-b4ea-4ba2-b89e-9273fcde292a req-4cf04d6d-6383-45e0-9dc6-c0a8e1ade949 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033854 Oct 17 03:55:46.152870 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 146/292] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 03:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:55:46.242356 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-2cd7105f-3fa6-4f6e-ac01-96ba5bf3e747 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:46.250148 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-2cd7105f-3fa6-4f6e-ac01-96ba5bf3e747 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7" status: 200 len: 1509 microversion: 2.1 time: 0.403019 Oct 17 03:55:46.250799 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 147/293] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:45 2022] GET /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7 => generated 1509 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:55:46.331843 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-bf95d7f0-4e83-46b3-b836-cf645d9c16b0 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:46.332577 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-bf95d7f0-4e83-46b3-b836-cf645d9c16b0 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:46.351729 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-bf95d7f0-4e83-46b3-b836-cf645d9c16b0 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:46.352279 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-bf95d7f0-4e83-46b3-b836-cf645d9c16b0 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:46.352728 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-bf95d7f0-4e83-46b3-b836-cf645d9c16b0 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:46.353455 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-bf95d7f0-4e83-46b3-b836-cf645d9c16b0 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:46.353919 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-bf95d7f0-4e83-46b3-b836-cf645d9c16b0 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:46.360809 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-bf95d7f0-4e83-46b3-b836-cf645d9c16b0 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:46.482890 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-2f6ee58e-573e-44ae-921f-12b0fc4470df tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:46.484172 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-2f6ee58e-573e-44ae-921f-12b0fc4470df tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 44d8e487-b994-45ac-b2e4-47a6b7d425fe] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:46.496733 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2f6ee58e-573e-44ae-921f-12b0fc4470df tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:46.499284 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2f6ee58e-573e-44ae-921f-12b0fc4470df tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:46.499767 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2f6ee58e-573e-44ae-921f-12b0fc4470df tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:46.502357 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2f6ee58e-573e-44ae-921f-12b0fc4470df tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:46.502959 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2f6ee58e-573e-44ae-921f-12b0fc4470df tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:46.503446 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2f6ee58e-573e-44ae-921f-12b0fc4470df tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:46.591479 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-bf95d7f0-4e83-46b3-b836-cf645d9c16b0 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:46.601787 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-bf95d7f0-4e83-46b3-b836-cf645d9c16b0 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1724 microversion: 2.1 time: 0.275578 Oct 17 03:55:46.602764 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 147/294] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:46 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1724 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:46.713251 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-2f6ee58e-573e-44ae-921f-12b0fc4470df tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:46.725646 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-2f6ee58e-573e-44ae-921f-12b0fc4470df tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/44d8e487-b994-45ac-b2e4-47a6b7d425fe" status: 200 len: 1367 microversion: 2.1 time: 0.247345 Oct 17 03:55:46.726241 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 148/295] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:46 2022] GET /compute/v2.1/servers/44d8e487-b994-45ac-b2e4-47a6b7d425fe => generated 1367 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:47.274342 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-932b7189-9674-461f-a7e4-f80256ca5407 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:47.275605 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-932b7189-9674-461f-a7e4-f80256ca5407 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 06e9c5ca-8770-4ed5-90ae-bad248ab7ff7] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:47.283227 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-932b7189-9674-461f-a7e4-f80256ca5407 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:47.284090 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-932b7189-9674-461f-a7e4-f80256ca5407 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:47.284599 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-932b7189-9674-461f-a7e4-f80256ca5407 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:47.285522 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-932b7189-9674-461f-a7e4-f80256ca5407 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:47.286188 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-932b7189-9674-461f-a7e4-f80256ca5407 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:47.286687 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-932b7189-9674-461f-a7e4-f80256ca5407 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:47.483732 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-932b7189-9674-461f-a7e4-f80256ca5407 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:47.502383 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-932b7189-9674-461f-a7e4-f80256ca5407 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7" status: 200 len: 1509 microversion: 2.1 time: 0.225011 Oct 17 03:55:47.503046 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 148/296] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:47 2022] GET /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7 => generated 1509 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:47.625243 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-af686fa2-be92-471f-9293-0095fc05a95f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:47.626236 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-af686fa2-be92-471f-9293-0095fc05a95f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:47.633187 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-af686fa2-be92-471f-9293-0095fc05a95f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:47.633893 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-af686fa2-be92-471f-9293-0095fc05a95f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:47.634341 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-af686fa2-be92-471f-9293-0095fc05a95f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:47.635762 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-af686fa2-be92-471f-9293-0095fc05a95f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:47.639397 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-af686fa2-be92-471f-9293-0095fc05a95f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:47.640695 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-af686fa2-be92-471f-9293-0095fc05a95f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:47.754001 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-af90318d-0352-49be-add3-3528314863ff tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:47.755074 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-af90318d-0352-49be-add3-3528314863ff tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 44d8e487-b994-45ac-b2e4-47a6b7d425fe] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:47.769091 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-af90318d-0352-49be-add3-3528314863ff tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:47.769882 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-af90318d-0352-49be-add3-3528314863ff tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:47.770474 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-af90318d-0352-49be-add3-3528314863ff tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:47.771463 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-af90318d-0352-49be-add3-3528314863ff tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:47.775915 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-af90318d-0352-49be-add3-3528314863ff tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:47.783666 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-af90318d-0352-49be-add3-3528314863ff tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:47.906624 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-af686fa2-be92-471f-9293-0095fc05a95f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:47.916619 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-af686fa2-be92-471f-9293-0095fc05a95f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1724 microversion: 2.1 time: 0.295194 Oct 17 03:55:47.917196 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 149/297] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:47 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1724 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:47.941300 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-af90318d-0352-49be-add3-3528314863ff tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:47.956036 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-af90318d-0352-49be-add3-3528314863ff tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/44d8e487-b994-45ac-b2e4-47a6b7d425fe" status: 200 len: 1367 microversion: 2.1 time: 0.201223 Oct 17 03:55:47.956036 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 149/298] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:47 2022] GET /compute/v2.1/servers/44d8e487-b994-45ac-b2e4-47a6b7d425fe => generated 1367 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:48.527881 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-8496d884-1f05-4992-9115-5a9889cd89f1 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:48.528495 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-8496d884-1f05-4992-9115-5a9889cd89f1 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 06e9c5ca-8770-4ed5-90ae-bad248ab7ff7] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:48.539499 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8496d884-1f05-4992-9115-5a9889cd89f1 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:48.542958 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8496d884-1f05-4992-9115-5a9889cd89f1 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:48.542958 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8496d884-1f05-4992-9115-5a9889cd89f1 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:48.542958 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8496d884-1f05-4992-9115-5a9889cd89f1 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:48.542958 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8496d884-1f05-4992-9115-5a9889cd89f1 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:48.543581 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8496d884-1f05-4992-9115-5a9889cd89f1 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:48.939689 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-83f9422f-cc28-492d-b9e8-6ae525bda0fa tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:48.940322 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-83f9422f-cc28-492d-b9e8-6ae525bda0fa tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:48.965196 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-83f9422f-cc28-492d-b9e8-6ae525bda0fa tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:48.972348 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-83f9422f-cc28-492d-b9e8-6ae525bda0fa tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:48.973504 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-83f9422f-cc28-492d-b9e8-6ae525bda0fa tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:48.977470 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-83f9422f-cc28-492d-b9e8-6ae525bda0fa tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:48.978662 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-83f9422f-cc28-492d-b9e8-6ae525bda0fa tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:48.978662 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-83f9422f-cc28-492d-b9e8-6ae525bda0fa tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:49.112997 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_cell0:SELECT=2 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:55:49.129157 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_cell0:SELECT=6 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:55:49.165824 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-8496d884-1f05-4992-9115-5a9889cd89f1 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:49.191334 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-8496d884-1f05-4992-9115-5a9889cd89f1 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7" status: 200 len: 1515 microversion: 2.1 time: 0.664851 Oct 17 03:55:49.192246 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 150/299] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:48 2022] GET /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7 => generated 1515 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:49.203751 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-039dc345-9192-40f1-9ce6-6160ec6ab2bb tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:49.204400 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-039dc345-9192-40f1-9ce6-6160ec6ab2bb tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 44d8e487-b994-45ac-b2e4-47a6b7d425fe] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:49.233587 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-039dc345-9192-40f1-9ce6-6160ec6ab2bb tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:49.239156 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-039dc345-9192-40f1-9ce6-6160ec6ab2bb tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:49.243353 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-039dc345-9192-40f1-9ce6-6160ec6ab2bb tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:49.243353 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-039dc345-9192-40f1-9ce6-6160ec6ab2bb tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:49.247380 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-039dc345-9192-40f1-9ce6-6160ec6ab2bb tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:49.247380 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-039dc345-9192-40f1-9ce6-6160ec6ab2bb tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:49.361336 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_cell0:SELECT=6 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:55:49.371592 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-83f9422f-cc28-492d-b9e8-6ae525bda0fa tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:49.381053 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-83f9422f-cc28-492d-b9e8-6ae525bda0fa tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1724 microversion: 2.1 time: 0.445138 Oct 17 03:55:49.381644 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 150/300] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:48 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1724 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:49.570156 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-039dc345-9192-40f1-9ce6-6160ec6ab2bb tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:49.599897 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-039dc345-9192-40f1-9ce6-6160ec6ab2bb tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/44d8e487-b994-45ac-b2e4-47a6b7d425fe" status: 200 len: 1367 microversion: 2.1 time: 0.406640 Oct 17 03:55:49.601273 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 151/301] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:49 2022] GET /compute/v2.1/servers/44d8e487-b994-45ac-b2e4-47a6b7d425fe => generated 1367 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:50.407524 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-8f2091af-e281-4374-919a-deef6ee5b744 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:50.409562 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-8f2091af-e281-4374-919a-deef6ee5b744 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:50.417625 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8f2091af-e281-4374-919a-deef6ee5b744 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:50.422104 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8f2091af-e281-4374-919a-deef6ee5b744 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:50.422104 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8f2091af-e281-4374-919a-deef6ee5b744 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:50.422104 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8f2091af-e281-4374-919a-deef6ee5b744 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:50.422104 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8f2091af-e281-4374-919a-deef6ee5b744 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:50.422524 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8f2091af-e281-4374-919a-deef6ee5b744 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:50.577992 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-8f2091af-e281-4374-919a-deef6ee5b744 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:50.599317 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-8f2091af-e281-4374-919a-deef6ee5b744 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1724 microversion: 2.1 time: 0.196835 Oct 17 03:55:50.600464 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 151/302] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:50 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1724 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:55:50.627478 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-1b696d12-fc06-4a6e-88b8-c3dffe0042b8 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:50.628109 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-1b696d12-fc06-4a6e-88b8-c3dffe0042b8 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 44d8e487-b994-45ac-b2e4-47a6b7d425fe] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:50.659222 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1b696d12-fc06-4a6e-88b8-c3dffe0042b8 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:50.659947 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1b696d12-fc06-4a6e-88b8-c3dffe0042b8 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:50.660802 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1b696d12-fc06-4a6e-88b8-c3dffe0042b8 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:50.662105 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1b696d12-fc06-4a6e-88b8-c3dffe0042b8 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:50.662967 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1b696d12-fc06-4a6e-88b8-c3dffe0042b8 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:50.663433 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1b696d12-fc06-4a6e-88b8-c3dffe0042b8 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:50.955913 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-1b696d12-fc06-4a6e-88b8-c3dffe0042b8 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:50.971759 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-1b696d12-fc06-4a6e-88b8-c3dffe0042b8 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/44d8e487-b994-45ac-b2e4-47a6b7d425fe" status: 200 len: 1367 microversion: 2.1 time: 0.349243 Oct 17 03:55:50.979808 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 152/303] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:50 2022] GET /compute/v2.1/servers/44d8e487-b994-45ac-b2e4-47a6b7d425fe => generated 1367 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:51.094281 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-3d6feb79-d7e4-4c80-9c30-defa37792d9d tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Action: 'create', calling method: .version_select at 0x7fd72a881d30>, body: {"keypair": {"name": "tempest-keypair-1819095120", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLn3R5v4xLSarsdORPPyjQc6h8aD5Gi2jPTpgzJdniK9mtbWb2BBUdfKsqGrR+4iqmT+9O4mqpByMSxlUgGMxsZtFidmx7jJz3mJW0ePMRzTYPVMorwzJKE0XzCSEQWKOA=="}} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:55:51.112394 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.quota [None req-3d6feb79-d7e4-4c80-9c30-defa37792d9d tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Getting quotas for project b033d35610f34401a99b912f145eb317. Resources: {'key_pairs'} {{(pid=125872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 03:55:51.117264 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.quota [None req-3d6feb79-d7e4-4c80-9c30-defa37792d9d tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Getting quotas for user fa0a6947667d48bfabf6aefad09c8325 and project b033d35610f34401a99b912f145eb317. Resources: {'key_pairs'} {{(pid=125872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 03:55:51.231873 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-3d6feb79-d7e4-4c80-9c30-defa37792d9d tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.141695 Oct 17 03:55:51.232550 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 152/304] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 17 03:55:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 03:55:51.634689 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-1c6af2a4-ddf2-4675-80e9-e3f6f6cfa9af tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:51.634689 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-1c6af2a4-ddf2-4675-80e9-e3f6f6cfa9af tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:51.639057 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=1 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:55:51.640520 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1c6af2a4-ddf2-4675-80e9-e3f6f6cfa9af tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:51.641025 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1c6af2a4-ddf2-4675-80e9-e3f6f6cfa9af tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:51.641460 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1c6af2a4-ddf2-4675-80e9-e3f6f6cfa9af tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:51.642174 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1c6af2a4-ddf2-4675-80e9-e3f6f6cfa9af tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:51.642640 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1c6af2a4-ddf2-4675-80e9-e3f6f6cfa9af tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:51.643065 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1c6af2a4-ddf2-4675-80e9-e3f6f6cfa9af tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:51.805770 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-1c6af2a4-ddf2-4675-80e9-e3f6f6cfa9af tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:51.817123 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-1c6af2a4-ddf2-4675-80e9-e3f6f6cfa9af tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1724 microversion: 2.1 time: 0.193208 Oct 17 03:55:51.817888 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 153/305] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:51 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1724 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:51.999165 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-69c2fb7c-9401-4166-93ce-0e5b94e0aa94 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:51.999803 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-69c2fb7c-9401-4166-93ce-0e5b94e0aa94 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 44d8e487-b994-45ac-b2e4-47a6b7d425fe] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:52.009671 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-69c2fb7c-9401-4166-93ce-0e5b94e0aa94 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:52.010235 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-69c2fb7c-9401-4166-93ce-0e5b94e0aa94 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:52.010690 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-69c2fb7c-9401-4166-93ce-0e5b94e0aa94 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:52.014912 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-69c2fb7c-9401-4166-93ce-0e5b94e0aa94 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:52.019756 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-69c2fb7c-9401-4166-93ce-0e5b94e0aa94 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:52.020655 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-69c2fb7c-9401-4166-93ce-0e5b94e0aa94 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:52.185734 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-69c2fb7c-9401-4166-93ce-0e5b94e0aa94 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:52.195476 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-69c2fb7c-9401-4166-93ce-0e5b94e0aa94 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/44d8e487-b994-45ac-b2e4-47a6b7d425fe" status: 200 len: 1367 microversion: 2.1 time: 0.199927 Oct 17 03:55:52.196108 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 153/306] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:51 2022] GET /compute/v2.1/servers/44d8e487-b994-45ac-b2e4-47a6b7d425fe => generated 1367 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:52.840139 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-3bac86de-035d-48a4-bd72-7f8484bdcaa2 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:52.840756 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-3bac86de-035d-48a4-bd72-7f8484bdcaa2 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:52.848933 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3bac86de-035d-48a4-bd72-7f8484bdcaa2 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:52.849430 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3bac86de-035d-48a4-bd72-7f8484bdcaa2 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:52.849865 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3bac86de-035d-48a4-bd72-7f8484bdcaa2 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:52.850642 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3bac86de-035d-48a4-bd72-7f8484bdcaa2 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:52.851833 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3bac86de-035d-48a4-bd72-7f8484bdcaa2 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:52.852286 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3bac86de-035d-48a4-bd72-7f8484bdcaa2 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:53.111694 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-3bac86de-035d-48a4-bd72-7f8484bdcaa2 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:53.122959 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-3bac86de-035d-48a4-bd72-7f8484bdcaa2 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1724 microversion: 2.1 time: 0.286584 Oct 17 03:55:53.135619 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 154/307] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:52 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1724 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:53.226525 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-9ddc9d43-c5d7-4ef8-a654-a668496d79aa tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:53.227151 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-9ddc9d43-c5d7-4ef8-a654-a668496d79aa tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 44d8e487-b994-45ac-b2e4-47a6b7d425fe] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:53.242281 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-9ddc9d43-c5d7-4ef8-a654-a668496d79aa tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:53.244216 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-9ddc9d43-c5d7-4ef8-a654-a668496d79aa tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:53.244681 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-9ddc9d43-c5d7-4ef8-a654-a668496d79aa tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:53.245450 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-9ddc9d43-c5d7-4ef8-a654-a668496d79aa tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:53.245913 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-9ddc9d43-c5d7-4ef8-a654-a668496d79aa tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:53.246341 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-9ddc9d43-c5d7-4ef8-a654-a668496d79aa tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:53.529283 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-9ddc9d43-c5d7-4ef8-a654-a668496d79aa tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:53.538860 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-9ddc9d43-c5d7-4ef8-a654-a668496d79aa tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/44d8e487-b994-45ac-b2e4-47a6b7d425fe" status: 200 len: 1367 microversion: 2.1 time: 0.315895 Oct 17 03:55:53.539923 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 154/308] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:53 2022] GET /compute/v2.1/servers/44d8e487-b994-45ac-b2e4-47a6b7d425fe => generated 1367 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:55:54.147583 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-48d1ca76-08ea-4a82-bafe-994f912b3f40 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:54.148390 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-48d1ca76-08ea-4a82-bafe-994f912b3f40 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:54.159139 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-48d1ca76-08ea-4a82-bafe-994f912b3f40 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:54.163716 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-48d1ca76-08ea-4a82-bafe-994f912b3f40 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:54.164245 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-48d1ca76-08ea-4a82-bafe-994f912b3f40 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:54.166486 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-48d1ca76-08ea-4a82-bafe-994f912b3f40 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:54.167037 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-48d1ca76-08ea-4a82-bafe-994f912b3f40 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:54.167497 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-48d1ca76-08ea-4a82-bafe-994f912b3f40 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:54.286020 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-bf241dac-fab9-445b-bffe-b32a10970772 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-790732146", "imageRef": "add1979e-0a3b-4403-a8ae-8d9a7b045fc2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f8073287-4612-43ec-a52d-7596b10ea924"}], "security_groups": [{"name": "tempest-securitygroup--1917468094"}], "key_name": "tempest-keypair-1819095120", "user_data": "}} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:55:54.438725 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.network.neutron [None req-bf241dac-fab9-445b-bffe-b32a10970772 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] validate_networks() for [('f8073287-4612-43ec-a52d-7596b10ea924', None, None, None, None, None)] {{(pid=125872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 03:55:54.464381 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-48d1ca76-08ea-4a82-bafe-994f912b3f40 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:54.476532 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-48d1ca76-08ea-4a82-bafe-994f912b3f40 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1724 microversion: 2.1 time: 0.333325 Oct 17 03:55:54.477109 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 155/309] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:54 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1724 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:54.565815 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-c686f68b-5170-4ace-911f-6d7fc0fe473e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:54.566951 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-c686f68b-5170-4ace-911f-6d7fc0fe473e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 44d8e487-b994-45ac-b2e4-47a6b7d425fe] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:54.573300 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c686f68b-5170-4ace-911f-6d7fc0fe473e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:54.581974 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c686f68b-5170-4ace-911f-6d7fc0fe473e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:54.582574 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c686f68b-5170-4ace-911f-6d7fc0fe473e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:54.583515 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c686f68b-5170-4ace-911f-6d7fc0fe473e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:54.585053 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c686f68b-5170-4ace-911f-6d7fc0fe473e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:54.587129 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c686f68b-5170-4ace-911f-6d7fc0fe473e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:55.123830 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.virt.hardware [None req-bf241dac-fab9-445b-bffe-b32a10970772 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Flavor limits 0:0:0 {{(pid=125872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 03:55:55.124568 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.virt.hardware [None req-bf241dac-fab9-445b-bffe-b32a10970772 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Image limits 0:0:0 {{(pid=125872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 03:55:55.125335 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.virt.hardware [None req-bf241dac-fab9-445b-bffe-b32a10970772 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Flavor pref 0:0:0 {{(pid=125872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 03:55:55.125955 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.virt.hardware [None req-bf241dac-fab9-445b-bffe-b32a10970772 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Image pref 0:0:0 {{(pid=125872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 03:55:55.126734 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.virt.hardware [None req-bf241dac-fab9-445b-bffe-b32a10970772 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 03:55:55.170296 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-bf241dac-fab9-445b-bffe-b32a10970772 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:55.171579 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-bf241dac-fab9-445b-bffe-b32a10970772 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:55.173684 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-bf241dac-fab9-445b-bffe-b32a10970772 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:55.175562 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-bf241dac-fab9-445b-bffe-b32a10970772 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:55.176597 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-bf241dac-fab9-445b-bffe-b32a10970772 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:55.178924 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-bf241dac-fab9-445b-bffe-b32a10970772 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:55.207451 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.quota [None req-bf241dac-fab9-445b-bffe-b32a10970772 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Getting quotas for project b033d35610f34401a99b912f145eb317. Resources: {'cores', 'instances', 'ram'} {{(pid=125872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 03:55:55.217248 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.quota [None req-bf241dac-fab9-445b-bffe-b32a10970772 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Getting quotas for user fa0a6947667d48bfabf6aefad09c8325 and project b033d35610f34401a99b912f145eb317. Resources: {'cores', 'instances', 'ram'} {{(pid=125872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 03:55:55.241947 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-c686f68b-5170-4ace-911f-6d7fc0fe473e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:55.252637 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-bf241dac-fab9-445b-bffe-b32a10970772 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Going to run 1 instances... {{(pid=125872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 03:55:55.256755 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-bf241dac-fab9-445b-bffe-b32a10970772 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 57546995-2ef9-4773-a47a-13cbd2a831a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='add1979e-0a3b-4403-a8ae-8d9a7b045fc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 03:55:55.265473 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-c686f68b-5170-4ace-911f-6d7fc0fe473e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/44d8e487-b994-45ac-b2e4-47a6b7d425fe" status: 200 len: 1367 microversion: 2.1 time: 0.705372 Oct 17 03:55:55.267067 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 156/310] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:54 2022] GET /compute/v2.1/servers/44d8e487-b994-45ac-b2e4-47a6b7d425fe => generated 1367 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:55:55.442473 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-bf241dac-fab9-445b-bffe-b32a10970772 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.153419 Oct 17 03:55:55.443640 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 155/311] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 17 03:55:54 2022] POST /compute/v2.1/servers => generated 409 bytes in 1167 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 03:55:55.456103 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-bf8ad144-e367-4a93-8843-c44b38545b71 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:55.456831 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-bf8ad144-e367-4a93-8843-c44b38545b71 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 57546995-2ef9-4773-a47a-13cbd2a831a9] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:55.502288 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-2c51a0df-b9c7-42fb-a557-52a557b1f8b0 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:55.508859 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-2c51a0df-b9c7-42fb-a557-52a557b1f8b0 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:55.517996 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2c51a0df-b9c7-42fb-a557-52a557b1f8b0 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:55.521012 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2c51a0df-b9c7-42fb-a557-52a557b1f8b0 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:55.524296 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2c51a0df-b9c7-42fb-a557-52a557b1f8b0 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:55.525402 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2c51a0df-b9c7-42fb-a557-52a557b1f8b0 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:55.528024 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2c51a0df-b9c7-42fb-a557-52a557b1f8b0 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:55.531356 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2c51a0df-b9c7-42fb-a557-52a557b1f8b0 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:55.586215 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-bf8ad144-e367-4a93-8843-c44b38545b71 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:55.595486 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-bf8ad144-e367-4a93-8843-c44b38545b71 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9" status: 200 len: 1245 microversion: 2.1 time: 0.144262 Oct 17 03:55:55.614230 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 157/312] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:55 2022] GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9 => generated 1245 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:55.753975 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [req-b60ee3d6-feb5-4871-bf5e-5273dde0e109 req-3ea3d937-da54-47b9-a471-0bc60ded2833 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44d8e487-b994-45ac-b2e4-47a6b7d425fe", "name": "network-vif-plugged", "status": "completed", "tag": "29b0d627-a2ca-49fa-8220-6e478eea9d13"}]} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:55:55.771113 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-b60ee3d6-feb5-4871-bf5e-5273dde0e109 req-3ea3d937-da54-47b9-a471-0bc60ded2833 service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:55.776383 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-b60ee3d6-feb5-4871-bf5e-5273dde0e109 req-3ea3d937-da54-47b9-a471-0bc60ded2833 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:55.778204 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-b60ee3d6-feb5-4871-bf5e-5273dde0e109 req-3ea3d937-da54-47b9-a471-0bc60ded2833 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:55.800982 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.compute.server_external_events [req-b60ee3d6-feb5-4871-bf5e-5273dde0e109 req-3ea3d937-da54-47b9-a471-0bc60ded2833 service nova] Creating event network-vif-plugged:29b0d627-a2ca-49fa-8220-6e478eea9d13 for instance 44d8e487-b994-45ac-b2e4-47a6b7d425fe on hv-cinder-81558 Oct 17 03:55:55.814833 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [req-b60ee3d6-feb5-4871-bf5e-5273dde0e109 req-3ea3d937-da54-47b9-a471-0bc60ded2833 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064683 Oct 17 03:55:55.816417 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 158/313] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 03:55:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 03:55:55.827239 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-2c51a0df-b9c7-42fb-a557-52a557b1f8b0 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:55.842681 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-2c51a0df-b9c7-42fb-a557-52a557b1f8b0 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1724 microversion: 2.1 time: 0.346091 Oct 17 03:55:55.843948 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 156/314] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:55 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1724 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:56.293021 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-af8cf2fa-e74e-4dd4-b7ad-a4e69ac19219 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:56.294393 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-af8cf2fa-e74e-4dd4-b7ad-a4e69ac19219 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 44d8e487-b994-45ac-b2e4-47a6b7d425fe] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:56.371264 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-af8cf2fa-e74e-4dd4-b7ad-a4e69ac19219 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:56.374793 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-af8cf2fa-e74e-4dd4-b7ad-a4e69ac19219 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:56.375376 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-af8cf2fa-e74e-4dd4-b7ad-a4e69ac19219 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:56.378496 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-af8cf2fa-e74e-4dd4-b7ad-a4e69ac19219 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:56.379285 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-af8cf2fa-e74e-4dd4-b7ad-a4e69ac19219 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:56.385957 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-af8cf2fa-e74e-4dd4-b7ad-a4e69ac19219 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:56.424322 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:55:56.639873 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-a8d8c4a9-4d00-4509-93aa-b7ae9614fbf5 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:56.640592 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-a8d8c4a9-4d00-4509-93aa-b7ae9614fbf5 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 57546995-2ef9-4773-a47a-13cbd2a831a9] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:56.712225 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-a8d8c4a9-4d00-4509-93aa-b7ae9614fbf5 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:56.723012 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-a8d8c4a9-4d00-4509-93aa-b7ae9614fbf5 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9" status: 200 len: 1245 microversion: 2.1 time: 0.088252 Oct 17 03:55:56.736267 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 157/315] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:56 2022] GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9 => generated 1245 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:55:56.817210 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-af8cf2fa-e74e-4dd4-b7ad-a4e69ac19219 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:56.825202 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-af8cf2fa-e74e-4dd4-b7ad-a4e69ac19219 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/44d8e487-b994-45ac-b2e4-47a6b7d425fe" status: 200 len: 1367 microversion: 2.1 time: 0.536469 Oct 17 03:55:56.826319 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 159/316] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:56 2022] GET /compute/v2.1/servers/44d8e487-b994-45ac-b2e4-47a6b7d425fe => generated 1367 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:56.868693 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-acfb550c-74a9-4e35-9bb6-ad6af0765346 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:56.869409 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-acfb550c-74a9-4e35-9bb6-ad6af0765346 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:56.877985 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-acfb550c-74a9-4e35-9bb6-ad6af0765346 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:56.879270 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-acfb550c-74a9-4e35-9bb6-ad6af0765346 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:56.880096 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-acfb550c-74a9-4e35-9bb6-ad6af0765346 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:56.881395 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-acfb550c-74a9-4e35-9bb6-ad6af0765346 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:56.882413 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-acfb550c-74a9-4e35-9bb6-ad6af0765346 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:56.883595 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-acfb550c-74a9-4e35-9bb6-ad6af0765346 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:57.068757 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-acfb550c-74a9-4e35-9bb6-ad6af0765346 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:57.097498 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-acfb550c-74a9-4e35-9bb6-ad6af0765346 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1724 microversion: 2.1 time: 0.232682 Oct 17 03:55:57.107938 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 158/317] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:56 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1724 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:57.746681 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-3fd7998b-d59a-4ba3-aad1-aa5cf891f310 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:57.749581 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-3fd7998b-d59a-4ba3-aad1-aa5cf891f310 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 57546995-2ef9-4773-a47a-13cbd2a831a9] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:57.757334 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3fd7998b-d59a-4ba3-aad1-aa5cf891f310 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:57.757886 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3fd7998b-d59a-4ba3-aad1-aa5cf891f310 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:57.758324 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3fd7998b-d59a-4ba3-aad1-aa5cf891f310 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:57.759020 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3fd7998b-d59a-4ba3-aad1-aa5cf891f310 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:57.764715 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3fd7998b-d59a-4ba3-aad1-aa5cf891f310 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:57.765648 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3fd7998b-d59a-4ba3-aad1-aa5cf891f310 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:57.850704 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-e0c76675-b783-48f4-835e-7468d0c0370c tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:57.851414 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-e0c76675-b783-48f4-835e-7468d0c0370c tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 44d8e487-b994-45ac-b2e4-47a6b7d425fe] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:57.863008 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e0c76675-b783-48f4-835e-7468d0c0370c tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:57.863593 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e0c76675-b783-48f4-835e-7468d0c0370c tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:57.864037 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e0c76675-b783-48f4-835e-7468d0c0370c tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:57.864763 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e0c76675-b783-48f4-835e-7468d0c0370c tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:57.865225 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e0c76675-b783-48f4-835e-7468d0c0370c tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:57.869738 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e0c76675-b783-48f4-835e-7468d0c0370c tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:57.888467 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-3fd7998b-d59a-4ba3-aad1-aa5cf891f310 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:57.897481 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-3fd7998b-d59a-4ba3-aad1-aa5cf891f310 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9" status: 200 len: 1241 microversion: 2.1 time: 0.155091 Oct 17 03:55:57.900900 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 160/318] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:57 2022] GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9 => generated 1241 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:58.134744 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-f05048e8-342f-4256-be05-ece6773df179 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:58.135807 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-f05048e8-342f-4256-be05-ece6773df179 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:58.142807 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f05048e8-342f-4256-be05-ece6773df179 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:58.143331 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f05048e8-342f-4256-be05-ece6773df179 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:58.143940 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f05048e8-342f-4256-be05-ece6773df179 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:58.144802 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f05048e8-342f-4256-be05-ece6773df179 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:58.145436 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f05048e8-342f-4256-be05-ece6773df179 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:58.146214 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f05048e8-342f-4256-be05-ece6773df179 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:58.171126 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-e0c76675-b783-48f4-835e-7468d0c0370c tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:58.180848 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-e0c76675-b783-48f4-835e-7468d0c0370c tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/44d8e487-b994-45ac-b2e4-47a6b7d425fe" status: 200 len: 1367 microversion: 2.1 time: 0.334085 Oct 17 03:55:58.197486 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 159/319] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:57 2022] GET /compute/v2.1/servers/44d8e487-b994-45ac-b2e4-47a6b7d425fe => generated 1367 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:55:58.359634 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-f05048e8-342f-4256-be05-ece6773df179 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:58.368468 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-f05048e8-342f-4256-be05-ece6773df179 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1724 microversion: 2.1 time: 0.237929 Oct 17 03:55:58.369216 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 161/320] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:58 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1724 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:58.926050 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-52cf3fcc-85b2-4d07-88c3-001f68f84636 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:58.926679 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-52cf3fcc-85b2-4d07-88c3-001f68f84636 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 57546995-2ef9-4773-a47a-13cbd2a831a9] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:58.936434 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-52cf3fcc-85b2-4d07-88c3-001f68f84636 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:58.941355 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-52cf3fcc-85b2-4d07-88c3-001f68f84636 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:58.942056 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-52cf3fcc-85b2-4d07-88c3-001f68f84636 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:58.942986 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-52cf3fcc-85b2-4d07-88c3-001f68f84636 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:58.944666 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-52cf3fcc-85b2-4d07-88c3-001f68f84636 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:58.945824 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-52cf3fcc-85b2-4d07-88c3-001f68f84636 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:59.040579 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-52cf3fcc-85b2-4d07-88c3-001f68f84636 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:59.049863 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-52cf3fcc-85b2-4d07-88c3-001f68f84636 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9" status: 200 len: 1297 microversion: 2.1 time: 0.129077 Oct 17 03:55:59.051364 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 160/321] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:58 2022] GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9 => generated 1297 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:59.205969 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-2a8a080f-3a2d-40fe-a91c-e2b908a1db4a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:59.206588 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-2a8a080f-3a2d-40fe-a91c-e2b908a1db4a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 44d8e487-b994-45ac-b2e4-47a6b7d425fe] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:59.216322 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2a8a080f-3a2d-40fe-a91c-e2b908a1db4a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:59.220725 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2a8a080f-3a2d-40fe-a91c-e2b908a1db4a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:59.221470 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2a8a080f-3a2d-40fe-a91c-e2b908a1db4a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:59.222430 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2a8a080f-3a2d-40fe-a91c-e2b908a1db4a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:59.223272 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2a8a080f-3a2d-40fe-a91c-e2b908a1db4a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:59.226099 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2a8a080f-3a2d-40fe-a91c-e2b908a1db4a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:59.396958 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-425db231-5ee7-4dbd-82c3-41f12823c777 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:59.397611 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-425db231-5ee7-4dbd-82c3-41f12823c777 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:59.408767 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-425db231-5ee7-4dbd-82c3-41f12823c777 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:59.409581 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-425db231-5ee7-4dbd-82c3-41f12823c777 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:59.409849 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-425db231-5ee7-4dbd-82c3-41f12823c777 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:59.411469 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-425db231-5ee7-4dbd-82c3-41f12823c777 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:59.412094 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-425db231-5ee7-4dbd-82c3-41f12823c777 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:59.412686 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-425db231-5ee7-4dbd-82c3-41f12823c777 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:59.440472 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_cell1:SELECT=100 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:55:59.443300 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-2a8a080f-3a2d-40fe-a91c-e2b908a1db4a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:55:59.453091 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-2a8a080f-3a2d-40fe-a91c-e2b908a1db4a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/44d8e487-b994-45ac-b2e4-47a6b7d425fe" status: 200 len: 1558 microversion: 2.1 time: 0.250854 Oct 17 03:55:59.470920 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 162/322] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:59 2022] GET /compute/v2.1/servers/44d8e487-b994-45ac-b2e4-47a6b7d425fe => generated 1558 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:55:59.479214 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-65ef6cd6-f1f2-4893-b3f9-c7180e2ceef9 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:55:59.481049 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-65ef6cd6-f1f2-4893-b3f9-c7180e2ceef9 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 44d8e487-b994-45ac-b2e4-47a6b7d425fe] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:55:59.490697 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-65ef6cd6-f1f2-4893-b3f9-c7180e2ceef9 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:59.491221 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-65ef6cd6-f1f2-4893-b3f9-c7180e2ceef9 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:59.491656 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-65ef6cd6-f1f2-4893-b3f9-c7180e2ceef9 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:59.492532 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-65ef6cd6-f1f2-4893-b3f9-c7180e2ceef9 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:55:59.493310 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-65ef6cd6-f1f2-4893-b3f9-c7180e2ceef9 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:55:59.493901 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-65ef6cd6-f1f2-4893-b3f9-c7180e2ceef9 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:55:59.626436 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-65ef6cd6-f1f2-4893-b3f9-c7180e2ceef9 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/44d8e487-b994-45ac-b2e4-47a6b7d425fe/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.153011 Oct 17 03:55:59.635475 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 163/323] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Oct 17 03:55:59 2022] GET /compute/v2.1/servers/44d8e487-b994-45ac-b2e4-47a6b7d425fe/os-interface => generated 285 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 03:56:00.019661 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-425db231-5ee7-4dbd-82c3-41f12823c777 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:00.030183 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-425db231-5ee7-4dbd-82c3-41f12823c777 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1701 microversion: 2.1 time: 0.637546 Oct 17 03:56:00.030776 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 161/324] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:55:59 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1701 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:56:00.056369 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-1e3c4608-d954-484a-9c4f-5050f08994a9 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:56:00.064677 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1e3c4608-d954-484a-9c4f-5050f08994a9 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:00.065386 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1e3c4608-d954-484a-9c4f-5050f08994a9 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:00.066038 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1e3c4608-d954-484a-9c4f-5050f08994a9 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:00.073318 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-f4284366-a6dd-4e36-b595-22f752bf59b1 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:00.074343 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-f4284366-a6dd-4e36-b595-22f752bf59b1 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 57546995-2ef9-4773-a47a-13cbd2a831a9] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:00.081384 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f4284366-a6dd-4e36-b595-22f752bf59b1 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:00.085732 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f4284366-a6dd-4e36-b595-22f752bf59b1 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:00.087710 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f4284366-a6dd-4e36-b595-22f752bf59b1 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:00.088697 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f4284366-a6dd-4e36-b595-22f752bf59b1 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:00.091866 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f4284366-a6dd-4e36-b595-22f752bf59b1 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:00.092500 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f4284366-a6dd-4e36-b595-22f752bf59b1 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:00.184994 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-1e3c4608-d954-484a-9c4f-5050f08994a9 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Going to try to start instance {{(pid=125871) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 17 03:56:00.399653 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-1e3c4608-d954-484a-9c4f-5050f08994a9 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "POST /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe/action" status: 202 len: 0 microversion: 2.1 time: 0.347368 Oct 17 03:56:00.412213 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 164/325] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 17 03:56:00 2022] POST /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe/action => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 03:56:00.423825 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-72de10fa-7541-4e5b-8423-fe3b830e61e5 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:00.424859 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-72de10fa-7541-4e5b-8423-fe3b830e61e5 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:00.433121 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-72de10fa-7541-4e5b-8423-fe3b830e61e5 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:00.433847 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-72de10fa-7541-4e5b-8423-fe3b830e61e5 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:00.434830 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-72de10fa-7541-4e5b-8423-fe3b830e61e5 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:00.435880 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-72de10fa-7541-4e5b-8423-fe3b830e61e5 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:00.436472 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-72de10fa-7541-4e5b-8423-fe3b830e61e5 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:00.437129 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-72de10fa-7541-4e5b-8423-fe3b830e61e5 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:00.498356 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-f4284366-a6dd-4e36-b595-22f752bf59b1 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:00.514421 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-f4284366-a6dd-4e36-b595-22f752bf59b1 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9" status: 200 len: 1303 microversion: 2.1 time: 0.442235 Oct 17 03:56:00.516025 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 162/326] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:00 2022] GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9 => generated 1303 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:56:01.175646 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-72de10fa-7541-4e5b-8423-fe3b830e61e5 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:01.175646 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-72de10fa-7541-4e5b-8423-fe3b830e61e5 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1710 microversion: 2.1 time: 0.359418 Oct 17 03:56:01.175646 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 165/327] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:00 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1710 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:56:01.543144 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-028ada6d-32cd-4634-bd10-a2ff60c9101f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:01.556051 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-028ada6d-32cd-4634-bd10-a2ff60c9101f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 57546995-2ef9-4773-a47a-13cbd2a831a9] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:01.586392 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-028ada6d-32cd-4634-bd10-a2ff60c9101f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:01.586906 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-028ada6d-32cd-4634-bd10-a2ff60c9101f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:01.587385 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-028ada6d-32cd-4634-bd10-a2ff60c9101f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:01.590161 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-028ada6d-32cd-4634-bd10-a2ff60c9101f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:01.591675 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-028ada6d-32cd-4634-bd10-a2ff60c9101f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:01.592130 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-028ada6d-32cd-4634-bd10-a2ff60c9101f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:01.802146 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-028ada6d-32cd-4634-bd10-a2ff60c9101f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:01.826976 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-028ada6d-32cd-4634-bd10-a2ff60c9101f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9" status: 200 len: 1303 microversion: 2.1 time: 0.288677 Oct 17 03:56:01.832482 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 163/328] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:01 2022] GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9 => generated 1303 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:56:01.887461 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [req-ef99fae3-7c38-4464-9169-ebc2f89c62f5 req-2e1d7b5c-4c1a-4dfa-a737-bedf1941e3d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44d8e487-b994-45ac-b2e4-47a6b7d425fe", "tag": "29b0d627-a2ca-49fa-8220-6e478eea9d13"}]} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:56:01.909998 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-ef99fae3-7c38-4464-9169-ebc2f89c62f5 req-2e1d7b5c-4c1a-4dfa-a737-bedf1941e3d8 service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:01.910815 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-ef99fae3-7c38-4464-9169-ebc2f89c62f5 req-2e1d7b5c-4c1a-4dfa-a737-bedf1941e3d8 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:01.912011 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-ef99fae3-7c38-4464-9169-ebc2f89c62f5 req-2e1d7b5c-4c1a-4dfa-a737-bedf1941e3d8 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:01.944791 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.compute.server_external_events [req-ef99fae3-7c38-4464-9169-ebc2f89c62f5 req-2e1d7b5c-4c1a-4dfa-a737-bedf1941e3d8 service nova] Creating event network-changed:29b0d627-a2ca-49fa-8220-6e478eea9d13 for instance 44d8e487-b994-45ac-b2e4-47a6b7d425fe on hv-cinder-81558 Oct 17 03:56:01.951465 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [req-ef99fae3-7c38-4464-9169-ebc2f89c62f5 req-2e1d7b5c-4c1a-4dfa-a737-bedf1941e3d8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070558 Oct 17 03:56:01.952772 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 166/329] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 03:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:56:02.170490 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-7acbd4d8-9b48-450f-914a-36d967b38d64 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:02.171185 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-7acbd4d8-9b48-450f-914a-36d967b38d64 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:02.179961 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-7acbd4d8-9b48-450f-914a-36d967b38d64 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:02.180830 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-7acbd4d8-9b48-450f-914a-36d967b38d64 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:02.181518 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-7acbd4d8-9b48-450f-914a-36d967b38d64 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:02.183694 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-7acbd4d8-9b48-450f-914a-36d967b38d64 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:02.184397 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-7acbd4d8-9b48-450f-914a-36d967b38d64 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:02.185045 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-7acbd4d8-9b48-450f-914a-36d967b38d64 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:02.749472 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-7acbd4d8-9b48-450f-914a-36d967b38d64 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:02.762759 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-7acbd4d8-9b48-450f-914a-36d967b38d64 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1710 microversion: 2.1 time: 0.595937 Oct 17 03:56:02.765238 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 164/330] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:02 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1710 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:56:02.859549 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-807cfd76-152e-425a-baf1-43e397e067d4 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:02.860643 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-807cfd76-152e-425a-baf1-43e397e067d4 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 57546995-2ef9-4773-a47a-13cbd2a831a9] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:02.882858 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-807cfd76-152e-425a-baf1-43e397e067d4 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:02.883769 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-807cfd76-152e-425a-baf1-43e397e067d4 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:02.884839 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-807cfd76-152e-425a-baf1-43e397e067d4 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:02.886201 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-807cfd76-152e-425a-baf1-43e397e067d4 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:02.886911 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-807cfd76-152e-425a-baf1-43e397e067d4 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:02.887579 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-807cfd76-152e-425a-baf1-43e397e067d4 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:03.226456 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-807cfd76-152e-425a-baf1-43e397e067d4 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:03.236535 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-807cfd76-152e-425a-baf1-43e397e067d4 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9" status: 200 len: 1371 microversion: 2.1 time: 0.378699 Oct 17 03:56:03.243558 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 167/331] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:02 2022] GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9 => generated 1371 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:56:03.546067 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-ccf2a321-2bd9-4ac6-b173-599497fd3068 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Action: 'create', calling method: .version_select at 0x7fd72a948790>, body: {"keypair": {"name": "tempest-TestShelveInstance-369098111", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHTTqHqlyZWWM7QiHHca2yLp2OOUk4lqsawIlHywDn/0eth0WEYsXJGcc/e6jDxe36TS4PqdVHkzkCapRq2y9Tm23Nzv7MprPEUxBFwJokcF0uvL4rsmjimok9Wx1btBQ=="}} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:56:03.569011 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.quota [None req-ccf2a321-2bd9-4ac6-b173-599497fd3068 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Getting quotas for project 0ba0a418ceb742fdb01c98c5d58424a1. Resources: {'key_pairs'} {{(pid=125872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 03:56:03.574124 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.quota [None req-ccf2a321-2bd9-4ac6-b173-599497fd3068 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Getting quotas for user 87b22f27c7144a3d96f41747473fe646 and project 0ba0a418ceb742fdb01c98c5d58424a1. Resources: {'key_pairs'} {{(pid=125872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 03:56:03.671509 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-ccf2a321-2bd9-4ac6-b173-599497fd3068 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.443916 Oct 17 03:56:03.679390 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 165/332] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 17 03:56:03 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:56:03.789685 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-cb2f0e61-d6d4-455a-9637-6980017dcd5f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:03.793831 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-cb2f0e61-d6d4-455a-9637-6980017dcd5f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:03.800128 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-cb2f0e61-d6d4-455a-9637-6980017dcd5f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:03.800627 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-cb2f0e61-d6d4-455a-9637-6980017dcd5f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:03.801325 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-cb2f0e61-d6d4-455a-9637-6980017dcd5f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:03.801771 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-cb2f0e61-d6d4-455a-9637-6980017dcd5f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:03.802230 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-cb2f0e61-d6d4-455a-9637-6980017dcd5f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:03.802696 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-cb2f0e61-d6d4-455a-9637-6980017dcd5f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:04.035919 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-cb2f0e61-d6d4-455a-9637-6980017dcd5f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:04.067518 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-cb2f0e61-d6d4-455a-9637-6980017dcd5f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1710 microversion: 2.1 time: 0.276652 Oct 17 03:56:04.079321 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 168/333] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:03 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1710 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:56:04.266519 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-ad5bc8bb-9b6c-4894-86df-bbc404ccf973 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:04.267757 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-ad5bc8bb-9b6c-4894-86df-bbc404ccf973 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 57546995-2ef9-4773-a47a-13cbd2a831a9] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:04.278604 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ad5bc8bb-9b6c-4894-86df-bbc404ccf973 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:04.279680 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ad5bc8bb-9b6c-4894-86df-bbc404ccf973 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:04.282592 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ad5bc8bb-9b6c-4894-86df-bbc404ccf973 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:04.284712 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ad5bc8bb-9b6c-4894-86df-bbc404ccf973 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:04.286113 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ad5bc8bb-9b6c-4894-86df-bbc404ccf973 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:04.287001 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ad5bc8bb-9b6c-4894-86df-bbc404ccf973 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:04.553514 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-ad5bc8bb-9b6c-4894-86df-bbc404ccf973 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:04.570777 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-ad5bc8bb-9b6c-4894-86df-bbc404ccf973 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9" status: 200 len: 1371 microversion: 2.1 time: 0.302627 Oct 17 03:56:04.570777 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 166/334] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:04 2022] GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9 => generated 1371 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:56:04.886020 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [req-90d2760e-6638-451e-b800-e8453b95216e req-101e0640-5b4f-4324-9488-eb4467512ceb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57546995-2ef9-4773-a47a-13cbd2a831a9", "tag": "6d4fd674-8999-42dd-8bcb-abfcc7aaca39"}]} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:56:04.901949 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-90d2760e-6638-451e-b800-e8453b95216e req-101e0640-5b4f-4324-9488-eb4467512ceb service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:04.908273 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-90d2760e-6638-451e-b800-e8453b95216e req-101e0640-5b4f-4324-9488-eb4467512ceb service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:04.908273 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-90d2760e-6638-451e-b800-e8453b95216e req-101e0640-5b4f-4324-9488-eb4467512ceb service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:04.941727 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.compute.server_external_events [req-90d2760e-6638-451e-b800-e8453b95216e req-101e0640-5b4f-4324-9488-eb4467512ceb service nova] Creating event network-changed:6d4fd674-8999-42dd-8bcb-abfcc7aaca39 for instance 57546995-2ef9-4773-a47a-13cbd2a831a9 on hv-cinder-81558 Oct 17 03:56:04.947040 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [req-90d2760e-6638-451e-b800-e8453b95216e req-101e0640-5b4f-4324-9488-eb4467512ceb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065882 Oct 17 03:56:04.948013 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 169/335] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 03:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:56:05.096093 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-7611d133-1feb-4707-84cb-3a112d74bd55 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:05.096953 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-7611d133-1feb-4707-84cb-3a112d74bd55 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:05.100749 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=94 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:56:05.104314 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-7611d133-1feb-4707-84cb-3a112d74bd55 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:05.104794 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-7611d133-1feb-4707-84cb-3a112d74bd55 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:05.105329 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-7611d133-1feb-4707-84cb-3a112d74bd55 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:05.106025 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-7611d133-1feb-4707-84cb-3a112d74bd55 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:05.106763 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-7611d133-1feb-4707-84cb-3a112d74bd55 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:05.107311 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-7611d133-1feb-4707-84cb-3a112d74bd55 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:05.207817 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_cell0:SELECT=2 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:56:05.349965 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-7611d133-1feb-4707-84cb-3a112d74bd55 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:05.360541 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-7611d133-1feb-4707-84cb-3a112d74bd55 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1714 microversion: 2.1 time: 0.268409 Oct 17 03:56:05.361342 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 167/336] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:05 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1714 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:56:05.592764 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-644b5e82-6052-475f-9578-59566b87daa4 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:05.593467 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-644b5e82-6052-475f-9578-59566b87daa4 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 57546995-2ef9-4773-a47a-13cbd2a831a9] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:05.604573 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_cell0:SELECT=2 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:56:05.621046 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-644b5e82-6052-475f-9578-59566b87daa4 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:05.622412 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-644b5e82-6052-475f-9578-59566b87daa4 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:05.623898 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-644b5e82-6052-475f-9578-59566b87daa4 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:05.625009 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-644b5e82-6052-475f-9578-59566b87daa4 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:05.625621 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-644b5e82-6052-475f-9578-59566b87daa4 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:05.626512 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-644b5e82-6052-475f-9578-59566b87daa4 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:05.834164 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-644b5e82-6052-475f-9578-59566b87daa4 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:05.847540 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-644b5e82-6052-475f-9578-59566b87daa4 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9" status: 200 len: 1371 microversion: 2.1 time: 0.259279 Oct 17 03:56:05.848129 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 170/337] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:05 2022] GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9 => generated 1371 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:56:05.911720 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-f4b6e803-a9ba-4461-a3f7-c35401088de1 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1894445555", "imageRef": "add1979e-0a3b-4403-a8ae-8d9a7b045fc2", "flavorRef": "452", "networks": [{"uuid": "3657b653-4efe-4ce1-bcc3-dc702e2e292e"}]}} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:56:05.975140 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.network.neutron [None req-f4b6e803-a9ba-4461-a3f7-c35401088de1 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] validate_networks() for [('3657b653-4efe-4ce1-bcc3-dc702e2e292e', None, None, None, None, None)] {{(pid=125872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 03:56:06.841832 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.virt.hardware [None req-f4b6e803-a9ba-4461-a3f7-c35401088de1 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Flavor limits 0:0:0 {{(pid=125872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 03:56:06.842434 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.virt.hardware [None req-f4b6e803-a9ba-4461-a3f7-c35401088de1 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Image limits 0:0:0 {{(pid=125872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 03:56:06.842772 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.virt.hardware [None req-f4b6e803-a9ba-4461-a3f7-c35401088de1 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Flavor pref 0:0:0 {{(pid=125872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 03:56:06.843218 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.virt.hardware [None req-f4b6e803-a9ba-4461-a3f7-c35401088de1 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Image pref 0:0:0 {{(pid=125872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 03:56:06.843611 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.virt.hardware [None req-f4b6e803-a9ba-4461-a3f7-c35401088de1 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 03:56:06.852304 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f4b6e803-a9ba-4461-a3f7-c35401088de1 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:06.852780 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f4b6e803-a9ba-4461-a3f7-c35401088de1 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:06.853209 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f4b6e803-a9ba-4461-a3f7-c35401088de1 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:06.853924 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f4b6e803-a9ba-4461-a3f7-c35401088de1 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:06.854479 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f4b6e803-a9ba-4461-a3f7-c35401088de1 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:06.855475 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f4b6e803-a9ba-4461-a3f7-c35401088de1 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:06.871482 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-03133ad5-a5a6-4e49-9a3e-e169a42ed6e4 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:06.871482 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-03133ad5-a5a6-4e49-9a3e-e169a42ed6e4 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 57546995-2ef9-4773-a47a-13cbd2a831a9] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:06.877592 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.quota [None req-f4b6e803-a9ba-4461-a3f7-c35401088de1 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Getting quotas for project b7543f344fc54e41836865a828c4754d. Resources: {'cores', 'instances', 'ram'} {{(pid=125872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 03:56:06.878638 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-03133ad5-a5a6-4e49-9a3e-e169a42ed6e4 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:06.879365 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-03133ad5-a5a6-4e49-9a3e-e169a42ed6e4 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:06.880049 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-03133ad5-a5a6-4e49-9a3e-e169a42ed6e4 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:06.881050 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-03133ad5-a5a6-4e49-9a3e-e169a42ed6e4 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:06.881580 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-03133ad5-a5a6-4e49-9a3e-e169a42ed6e4 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:06.882137 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-03133ad5-a5a6-4e49-9a3e-e169a42ed6e4 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:06.884364 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.quota [None req-f4b6e803-a9ba-4461-a3f7-c35401088de1 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Getting quotas for user a421a2a8899342b38aa61676f3b7bc01 and project b7543f344fc54e41836865a828c4754d. Resources: {'cores', 'instances', 'ram'} {{(pid=125872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 03:56:06.897268 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-f4b6e803-a9ba-4461-a3f7-c35401088de1 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Going to run 1 instances... {{(pid=125872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 03:56:06.899490 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-f4b6e803-a9ba-4461-a3f7-c35401088de1 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] [instance: 799ed606-0d4b-42b8-9faa-1d82271135d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='add1979e-0a3b-4403-a8ae-8d9a7b045fc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 03:56:07.045296 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-03133ad5-a5a6-4e49-9a3e-e169a42ed6e4 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:07.059657 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-03133ad5-a5a6-4e49-9a3e-e169a42ed6e4 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9" status: 200 len: 1371 microversion: 2.1 time: 0.191870 Oct 17 03:56:07.061971 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 171/338] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:06 2022] GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9 => generated 1371 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:56:07.077269 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-f4b6e803-a9ba-4461-a3f7-c35401088de1 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.168075 Oct 17 03:56:07.078079 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 168/339] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 17 03:56:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1171 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 03:56:07.096030 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-d1ecef65-91dc-48f5-823d-47190a1a337c tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:07.096649 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-d1ecef65-91dc-48f5-823d-47190a1a337c tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] [instance: 799ed606-0d4b-42b8-9faa-1d82271135d1] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:07.180594 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-d1ecef65-91dc-48f5-823d-47190a1a337c tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a421a2a8899342b38aa61676f3b7bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7543f344fc54e41836865a828c4754d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:07.203306 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-d1ecef65-91dc-48f5-823d-47190a1a337c tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] 10.222.0.16 "GET /compute/v2.1/servers/799ed606-0d4b-42b8-9faa-1d82271135d1" status: 200 len: 1214 microversion: 2.1 time: 0.099118 Oct 17 03:56:07.215226 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 172/340] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:07 2022] GET /compute/v2.1/servers/799ed606-0d4b-42b8-9faa-1d82271135d1 => generated 1214 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:56:08.083385 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-1f7d3ff8-846d-4f7b-aef7-d00f040abdd9 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:08.084272 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-1f7d3ff8-846d-4f7b-aef7-d00f040abdd9 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 57546995-2ef9-4773-a47a-13cbd2a831a9] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:08.092540 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1f7d3ff8-846d-4f7b-aef7-d00f040abdd9 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:08.093268 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1f7d3ff8-846d-4f7b-aef7-d00f040abdd9 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:08.093795 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1f7d3ff8-846d-4f7b-aef7-d00f040abdd9 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:08.094641 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1f7d3ff8-846d-4f7b-aef7-d00f040abdd9 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:08.095231 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1f7d3ff8-846d-4f7b-aef7-d00f040abdd9 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:08.096131 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1f7d3ff8-846d-4f7b-aef7-d00f040abdd9 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:08.219014 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-983fb675-016a-49c6-8082-420cb11496ed tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:08.219646 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-983fb675-016a-49c6-8082-420cb11496ed tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] [instance: 799ed606-0d4b-42b8-9faa-1d82271135d1] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:08.234633 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-1f7d3ff8-846d-4f7b-aef7-d00f040abdd9 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:08.243803 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-1f7d3ff8-846d-4f7b-aef7-d00f040abdd9 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9" status: 200 len: 1371 microversion: 2.1 time: 0.164340 Oct 17 03:56:08.244413 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 169/341] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:08 2022] GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9 => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:56:08.284082 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-983fb675-016a-49c6-8082-420cb11496ed tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a421a2a8899342b38aa61676f3b7bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7543f344fc54e41836865a828c4754d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:08.291688 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-983fb675-016a-49c6-8082-420cb11496ed tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] 10.222.0.16 "GET /compute/v2.1/servers/799ed606-0d4b-42b8-9faa-1d82271135d1" status: 200 len: 1214 microversion: 2.1 time: 0.077216 Oct 17 03:56:08.292255 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 173/342] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:08 2022] GET /compute/v2.1/servers/799ed606-0d4b-42b8-9faa-1d82271135d1 => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:56:09.268315 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-a369f1c5-da14-47bc-b548-e0105437d2e6 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:09.269993 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-a369f1c5-da14-47bc-b548-e0105437d2e6 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 57546995-2ef9-4773-a47a-13cbd2a831a9] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:09.276651 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a369f1c5-da14-47bc-b548-e0105437d2e6 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:09.277068 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a369f1c5-da14-47bc-b548-e0105437d2e6 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:09.277688 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a369f1c5-da14-47bc-b548-e0105437d2e6 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:09.278599 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a369f1c5-da14-47bc-b548-e0105437d2e6 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:09.279222 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a369f1c5-da14-47bc-b548-e0105437d2e6 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:09.279647 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a369f1c5-da14-47bc-b548-e0105437d2e6 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:09.315621 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-ed9287d2-ecc0-4431-8c26-12d45d75e60d tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:09.317119 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-ed9287d2-ecc0-4431-8c26-12d45d75e60d tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] [instance: 799ed606-0d4b-42b8-9faa-1d82271135d1] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:09.323723 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ed9287d2-ecc0-4431-8c26-12d45d75e60d tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:09.327346 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ed9287d2-ecc0-4431-8c26-12d45d75e60d tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:09.327346 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ed9287d2-ecc0-4431-8c26-12d45d75e60d tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:09.327346 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ed9287d2-ecc0-4431-8c26-12d45d75e60d tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:09.327346 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ed9287d2-ecc0-4431-8c26-12d45d75e60d tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:09.327911 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ed9287d2-ecc0-4431-8c26-12d45d75e60d tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:09.441991 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-ed9287d2-ecc0-4431-8c26-12d45d75e60d tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a421a2a8899342b38aa61676f3b7bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7543f344fc54e41836865a828c4754d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:09.460980 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-ed9287d2-ecc0-4431-8c26-12d45d75e60d tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] 10.222.0.16 "GET /compute/v2.1/servers/799ed606-0d4b-42b8-9faa-1d82271135d1" status: 200 len: 1266 microversion: 2.1 time: 0.150064 Oct 17 03:56:09.462161 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 174/343] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:09 2022] GET /compute/v2.1/servers/799ed606-0d4b-42b8-9faa-1d82271135d1 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:56:09.490496 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-a369f1c5-da14-47bc-b548-e0105437d2e6 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:09.501573 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-a369f1c5-da14-47bc-b548-e0105437d2e6 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9" status: 200 len: 1371 microversion: 2.1 time: 0.236789 Oct 17 03:56:09.502195 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 170/344] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:09 2022] GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9 => generated 1371 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:56:09.542758 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-21cf2f65-2e02-487b-a2f9-592325be162a tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-689608759", "imageRef": "add1979e-0a3b-4403-a8ae-8d9a7b045fc2", "flavorRef": "452", "networks": [{"uuid": "5315d0bd-538c-4a9e-975e-d56c527bda19"}]}} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:56:09.599786 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.network.neutron [None req-21cf2f65-2e02-487b-a2f9-592325be162a tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] validate_networks() for [('5315d0bd-538c-4a9e-975e-d56c527bda19', None, None, None, None, None)] {{(pid=125871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 03:56:09.967620 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.virt.hardware [None req-21cf2f65-2e02-487b-a2f9-592325be162a tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Flavor limits 0:0:0 {{(pid=125871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 03:56:09.968620 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.virt.hardware [None req-21cf2f65-2e02-487b-a2f9-592325be162a tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Image limits 0:0:0 {{(pid=125871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 03:56:09.969226 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.virt.hardware [None req-21cf2f65-2e02-487b-a2f9-592325be162a tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Flavor pref 0:0:0 {{(pid=125871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 03:56:09.969652 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.virt.hardware [None req-21cf2f65-2e02-487b-a2f9-592325be162a tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Image pref 0:0:0 {{(pid=125871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 03:56:09.970113 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.virt.hardware [None req-21cf2f65-2e02-487b-a2f9-592325be162a tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 03:56:09.979464 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-21cf2f65-2e02-487b-a2f9-592325be162a tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:09.980003 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-21cf2f65-2e02-487b-a2f9-592325be162a tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:09.980438 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-21cf2f65-2e02-487b-a2f9-592325be162a tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:09.981171 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-21cf2f65-2e02-487b-a2f9-592325be162a tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:09.981628 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-21cf2f65-2e02-487b-a2f9-592325be162a tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:09.982055 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-21cf2f65-2e02-487b-a2f9-592325be162a tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:09.999310 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.quota [None req-21cf2f65-2e02-487b-a2f9-592325be162a tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Getting quotas for project f9ed59353a4741cbb901808f7d2210d0. Resources: {'cores', 'instances', 'ram'} {{(pid=125871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 03:56:10.003320 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.quota [None req-21cf2f65-2e02-487b-a2f9-592325be162a tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Getting quotas for user c53ffc76632a456d9e833381783d4dd8 and project f9ed59353a4741cbb901808f7d2210d0. Resources: {'cores', 'instances', 'ram'} {{(pid=125871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 03:56:10.015941 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-21cf2f65-2e02-487b-a2f9-592325be162a tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Going to run 1 instances... {{(pid=125871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 03:56:10.018853 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-21cf2f65-2e02-487b-a2f9-592325be162a tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] [instance: 52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='add1979e-0a3b-4403-a8ae-8d9a7b045fc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 03:56:10.133093 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-21cf2f65-2e02-487b-a2f9-592325be162a tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.594414 Oct 17 03:56:10.134726 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 175/345] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 17 03:56:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 03:56:10.147663 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-6c6befff-3780-4f17-8459-d98a016f6621 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:10.148924 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-6c6befff-3780-4f17-8459-d98a016f6621 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] [instance: 52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:10.228513 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-6c6befff-3780-4f17-8459-d98a016f6621 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ffc76632a456d9e833381783d4dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed59353a4741cbb901808f7d2210d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:10.236623 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-6c6befff-3780-4f17-8459-d98a016f6621 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] 10.222.0.16 "GET /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0" status: 200 len: 1218 microversion: 2.1 time: 0.093304 Oct 17 03:56:10.243832 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 171/346] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:10 2022] GET /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0 => generated 1218 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:56:10.486456 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-87305236-323e-4128-ad5d-906b3386eacc tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:10.487142 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-87305236-323e-4128-ad5d-906b3386eacc tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] [instance: 799ed606-0d4b-42b8-9faa-1d82271135d1] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:10.493991 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-87305236-323e-4128-ad5d-906b3386eacc tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:10.494518 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-87305236-323e-4128-ad5d-906b3386eacc tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:10.494975 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-87305236-323e-4128-ad5d-906b3386eacc tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:10.499976 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-87305236-323e-4128-ad5d-906b3386eacc tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:10.499976 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-87305236-323e-4128-ad5d-906b3386eacc tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:10.499976 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-87305236-323e-4128-ad5d-906b3386eacc tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:10.525772 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-dbac0dbe-0422-42a8-9e5a-e0728d461ae0 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:10.526380 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-dbac0dbe-0422-42a8-9e5a-e0728d461ae0 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 57546995-2ef9-4773-a47a-13cbd2a831a9] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:10.534362 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-dbac0dbe-0422-42a8-9e5a-e0728d461ae0 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:10.535122 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-dbac0dbe-0422-42a8-9e5a-e0728d461ae0 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:10.535732 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-dbac0dbe-0422-42a8-9e5a-e0728d461ae0 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:10.536508 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-dbac0dbe-0422-42a8-9e5a-e0728d461ae0 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:10.537036 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-dbac0dbe-0422-42a8-9e5a-e0728d461ae0 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:10.537548 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-dbac0dbe-0422-42a8-9e5a-e0728d461ae0 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:10.570664 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-87305236-323e-4128-ad5d-906b3386eacc tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a421a2a8899342b38aa61676f3b7bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7543f344fc54e41836865a828c4754d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:10.579916 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-87305236-323e-4128-ad5d-906b3386eacc tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] 10.222.0.16 "GET /compute/v2.1/servers/799ed606-0d4b-42b8-9faa-1d82271135d1" status: 200 len: 1272 microversion: 2.1 time: 0.098375 Oct 17 03:56:10.582033 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 176/347] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:10 2022] GET /compute/v2.1/servers/799ed606-0d4b-42b8-9faa-1d82271135d1 => generated 1272 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:56:10.745562 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-dbac0dbe-0422-42a8-9e5a-e0728d461ae0 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:10.756410 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-dbac0dbe-0422-42a8-9e5a-e0728d461ae0 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9" status: 200 len: 1371 microversion: 2.1 time: 0.234384 Oct 17 03:56:10.758551 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 172/348] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:10 2022] GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9 => generated 1371 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:56:11.268252 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-c11b577d-6c3c-4888-b570-161bf3dd46b1 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:11.269166 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-c11b577d-6c3c-4888-b570-161bf3dd46b1 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] [instance: 52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:11.356987 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-c11b577d-6c3c-4888-b570-161bf3dd46b1 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ffc76632a456d9e833381783d4dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed59353a4741cbb901808f7d2210d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:11.365484 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-c11b577d-6c3c-4888-b570-161bf3dd46b1 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] 10.222.0.16 "GET /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0" status: 200 len: 1218 microversion: 2.1 time: 0.100955 Oct 17 03:56:11.376591 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 177/349] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:11 2022] GET /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0 => generated 1218 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:56:11.602363 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-d228be08-1fb4-415d-9c1f-c8d75cbe0918 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:11.602979 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-d228be08-1fb4-415d-9c1f-c8d75cbe0918 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] [instance: 799ed606-0d4b-42b8-9faa-1d82271135d1] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:11.610434 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d228be08-1fb4-415d-9c1f-c8d75cbe0918 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:11.611194 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d228be08-1fb4-415d-9c1f-c8d75cbe0918 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:11.611415 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d228be08-1fb4-415d-9c1f-c8d75cbe0918 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:11.612139 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d228be08-1fb4-415d-9c1f-c8d75cbe0918 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:11.612592 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d228be08-1fb4-415d-9c1f-c8d75cbe0918 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:11.613010 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d228be08-1fb4-415d-9c1f-c8d75cbe0918 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:11.782797 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-f20c252e-ceec-4817-91f7-b773d9eaed9b tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:11.783454 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-f20c252e-ceec-4817-91f7-b773d9eaed9b tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 57546995-2ef9-4773-a47a-13cbd2a831a9] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:11.793180 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f20c252e-ceec-4817-91f7-b773d9eaed9b tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:11.793672 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f20c252e-ceec-4817-91f7-b773d9eaed9b tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:11.794106 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f20c252e-ceec-4817-91f7-b773d9eaed9b tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:11.794806 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f20c252e-ceec-4817-91f7-b773d9eaed9b tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:11.795297 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f20c252e-ceec-4817-91f7-b773d9eaed9b tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:11.795950 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f20c252e-ceec-4817-91f7-b773d9eaed9b tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:11.844114 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-d228be08-1fb4-415d-9c1f-c8d75cbe0918 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a421a2a8899342b38aa61676f3b7bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7543f344fc54e41836865a828c4754d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:11.852418 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-d228be08-1fb4-415d-9c1f-c8d75cbe0918 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] 10.222.0.16 "GET /compute/v2.1/servers/799ed606-0d4b-42b8-9faa-1d82271135d1" status: 200 len: 1314 microversion: 2.1 time: 0.253952 Oct 17 03:56:11.853246 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 173/350] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:11 2022] GET /compute/v2.1/servers/799ed606-0d4b-42b8-9faa-1d82271135d1 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:56:11.985993 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-f20c252e-ceec-4817-91f7-b773d9eaed9b tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:11.993932 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-f20c252e-ceec-4817-91f7-b773d9eaed9b tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9" status: 200 len: 1371 microversion: 2.1 time: 0.216170 Oct 17 03:56:11.994516 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 178/351] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:11 2022] GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9 => generated 1371 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:56:12.189822 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [req-f4bcaeed-e1f8-4b71-9de6-015ab28bc4fe req-ab6d0c1b-ecba-401a-b253-39233c0bc7ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "799ed606-0d4b-42b8-9faa-1d82271135d1", "tag": "89532930-a662-4754-ba36-6a728a041f10"}]} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:56:12.203042 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-f4bcaeed-e1f8-4b71-9de6-015ab28bc4fe req-ab6d0c1b-ecba-401a-b253-39233c0bc7ee service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:12.209505 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-f4bcaeed-e1f8-4b71-9de6-015ab28bc4fe req-ab6d0c1b-ecba-401a-b253-39233c0bc7ee service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:12.209505 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-f4bcaeed-e1f8-4b71-9de6-015ab28bc4fe req-ab6d0c1b-ecba-401a-b253-39233c0bc7ee service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:12.216747 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.compute.server_external_events [req-f4bcaeed-e1f8-4b71-9de6-015ab28bc4fe req-ab6d0c1b-ecba-401a-b253-39233c0bc7ee service nova] Creating event network-changed:89532930-a662-4754-ba36-6a728a041f10 for instance 799ed606-0d4b-42b8-9faa-1d82271135d1 on hv-cinder-81558 Oct 17 03:56:12.222255 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [req-f4bcaeed-e1f8-4b71-9de6-015ab28bc4fe req-ab6d0c1b-ecba-401a-b253-39233c0bc7ee service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036812 Oct 17 03:56:12.223250 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 174/352] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 03:56:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:56:12.389980 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-96fb206a-5349-4261-8b18-4b5600f71a41 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:12.391468 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-96fb206a-5349-4261-8b18-4b5600f71a41 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] [instance: 52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:12.398499 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-96fb206a-5349-4261-8b18-4b5600f71a41 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:12.399071 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-96fb206a-5349-4261-8b18-4b5600f71a41 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:12.399536 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-96fb206a-5349-4261-8b18-4b5600f71a41 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:12.400243 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-96fb206a-5349-4261-8b18-4b5600f71a41 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:12.403726 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-96fb206a-5349-4261-8b18-4b5600f71a41 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:12.403726 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-96fb206a-5349-4261-8b18-4b5600f71a41 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:12.481659 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-96fb206a-5349-4261-8b18-4b5600f71a41 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ffc76632a456d9e833381783d4dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed59353a4741cbb901808f7d2210d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:12.497371 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-96fb206a-5349-4261-8b18-4b5600f71a41 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] 10.222.0.16 "GET /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0" status: 200 len: 1270 microversion: 2.1 time: 0.113192 Oct 17 03:56:12.498063 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 179/353] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:12 2022] GET /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0 => generated 1270 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:56:12.875111 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-d5fe077f-d149-4fb8-b105-08e1a51e40fa tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:12.875857 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-d5fe077f-d149-4fb8-b105-08e1a51e40fa tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] [instance: 799ed606-0d4b-42b8-9faa-1d82271135d1] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:12.883244 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d5fe077f-d149-4fb8-b105-08e1a51e40fa tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:12.887264 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d5fe077f-d149-4fb8-b105-08e1a51e40fa tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:12.887264 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d5fe077f-d149-4fb8-b105-08e1a51e40fa tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:12.887264 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d5fe077f-d149-4fb8-b105-08e1a51e40fa tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:12.887264 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d5fe077f-d149-4fb8-b105-08e1a51e40fa tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:12.887610 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d5fe077f-d149-4fb8-b105-08e1a51e40fa tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:12.911076 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [req-15be6f16-59f1-44d4-acbc-670f84b435ac req-a047804f-2054-454e-af94-83a86f10d82e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57546995-2ef9-4773-a47a-13cbd2a831a9", "name": "network-vif-plugged", "status": "completed", "tag": "6d4fd674-8999-42dd-8bcb-abfcc7aaca39"}]} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:56:12.925003 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-15be6f16-59f1-44d4-acbc-670f84b435ac req-a047804f-2054-454e-af94-83a86f10d82e service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:12.925491 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-15be6f16-59f1-44d4-acbc-670f84b435ac req-a047804f-2054-454e-af94-83a86f10d82e service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:12.925922 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-15be6f16-59f1-44d4-acbc-670f84b435ac req-a047804f-2054-454e-af94-83a86f10d82e service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:12.938987 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.compute.server_external_events [req-15be6f16-59f1-44d4-acbc-670f84b435ac req-a047804f-2054-454e-af94-83a86f10d82e service nova] Creating event network-vif-plugged:6d4fd674-8999-42dd-8bcb-abfcc7aaca39 for instance 57546995-2ef9-4773-a47a-13cbd2a831a9 on hv-cinder-81558 Oct 17 03:56:12.947930 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [req-15be6f16-59f1-44d4-acbc-670f84b435ac req-a047804f-2054-454e-af94-83a86f10d82e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040284 Oct 17 03:56:12.948674 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 180/354] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 03:56:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:56:13.021634 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-b80a3cab-a926-4b69-a86f-970b3c182a13 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:13.022872 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-b80a3cab-a926-4b69-a86f-970b3c182a13 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 57546995-2ef9-4773-a47a-13cbd2a831a9] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:13.032287 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b80a3cab-a926-4b69-a86f-970b3c182a13 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:13.033573 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b80a3cab-a926-4b69-a86f-970b3c182a13 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:13.033931 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b80a3cab-a926-4b69-a86f-970b3c182a13 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:13.035196 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b80a3cab-a926-4b69-a86f-970b3c182a13 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:13.035856 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b80a3cab-a926-4b69-a86f-970b3c182a13 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:13.036457 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b80a3cab-a926-4b69-a86f-970b3c182a13 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:13.055784 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:56:13.182611 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-d5fe077f-d149-4fb8-b105-08e1a51e40fa tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a421a2a8899342b38aa61676f3b7bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7543f344fc54e41836865a828c4754d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:13.198119 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-d5fe077f-d149-4fb8-b105-08e1a51e40fa tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] 10.222.0.16 "GET /compute/v2.1/servers/799ed606-0d4b-42b8-9faa-1d82271135d1" status: 200 len: 1314 microversion: 2.1 time: 0.327016 Oct 17 03:56:13.200475 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 175/355] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:12 2022] GET /compute/v2.1/servers/799ed606-0d4b-42b8-9faa-1d82271135d1 => generated 1314 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:56:13.425494 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-b80a3cab-a926-4b69-a86f-970b3c182a13 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:13.434414 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-b80a3cab-a926-4b69-a86f-970b3c182a13 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9" status: 200 len: 1371 microversion: 2.1 time: 0.419230 Oct 17 03:56:13.435095 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 181/356] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:13 2022] GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9 => generated 1371 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:56:13.520277 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-6b1dc0e9-0a01-4962-b04f-09c4f3b55e96 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:13.523137 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-6b1dc0e9-0a01-4962-b04f-09c4f3b55e96 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] [instance: 52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:13.526762 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6b1dc0e9-0a01-4962-b04f-09c4f3b55e96 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:13.527220 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6b1dc0e9-0a01-4962-b04f-09c4f3b55e96 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:13.528291 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6b1dc0e9-0a01-4962-b04f-09c4f3b55e96 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:13.529056 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6b1dc0e9-0a01-4962-b04f-09c4f3b55e96 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:13.529535 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6b1dc0e9-0a01-4962-b04f-09c4f3b55e96 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:13.529975 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6b1dc0e9-0a01-4962-b04f-09c4f3b55e96 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:13.597783 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-6b1dc0e9-0a01-4962-b04f-09c4f3b55e96 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ffc76632a456d9e833381783d4dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed59353a4741cbb901808f7d2210d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:13.605709 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-6b1dc0e9-0a01-4962-b04f-09c4f3b55e96 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] 10.222.0.16 "GET /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0" status: 200 len: 1288 microversion: 2.1 time: 0.089265 Oct 17 03:56:13.606295 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 176/357] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:13 2022] GET /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0 => generated 1288 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:56:14.221785 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-605774c3-4d63-4424-8c37-9d1534062bb3 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:14.222414 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-605774c3-4d63-4424-8c37-9d1534062bb3 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] [instance: 799ed606-0d4b-42b8-9faa-1d82271135d1] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:14.229835 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-605774c3-4d63-4424-8c37-9d1534062bb3 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:14.230324 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-605774c3-4d63-4424-8c37-9d1534062bb3 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:14.231283 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-605774c3-4d63-4424-8c37-9d1534062bb3 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:14.231994 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-605774c3-4d63-4424-8c37-9d1534062bb3 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:14.232449 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-605774c3-4d63-4424-8c37-9d1534062bb3 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:14.232874 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-605774c3-4d63-4424-8c37-9d1534062bb3 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:14.361077 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-605774c3-4d63-4424-8c37-9d1534062bb3 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a421a2a8899342b38aa61676f3b7bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7543f344fc54e41836865a828c4754d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:14.368853 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-605774c3-4d63-4424-8c37-9d1534062bb3 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] 10.222.0.16 "GET /compute/v2.1/servers/799ed606-0d4b-42b8-9faa-1d82271135d1" status: 200 len: 1314 microversion: 2.1 time: 0.150898 Oct 17 03:56:14.369352 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 182/358] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:14 2022] GET /compute/v2.1/servers/799ed606-0d4b-42b8-9faa-1d82271135d1 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:56:14.458144 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-543010f1-0fcd-445a-924f-653e8d77b3d6 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:14.459294 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-543010f1-0fcd-445a-924f-653e8d77b3d6 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 57546995-2ef9-4773-a47a-13cbd2a831a9] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:14.466696 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-543010f1-0fcd-445a-924f-653e8d77b3d6 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:14.467204 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-543010f1-0fcd-445a-924f-653e8d77b3d6 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:14.467638 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-543010f1-0fcd-445a-924f-653e8d77b3d6 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:14.468340 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-543010f1-0fcd-445a-924f-653e8d77b3d6 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:14.468783 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-543010f1-0fcd-445a-924f-653e8d77b3d6 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:14.469301 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-543010f1-0fcd-445a-924f-653e8d77b3d6 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:14.608278 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-543010f1-0fcd-445a-924f-653e8d77b3d6 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:14.614584 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-543010f1-0fcd-445a-924f-653e8d77b3d6 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9" status: 200 len: 1371 microversion: 2.1 time: 0.160703 Oct 17 03:56:14.615165 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 177/359] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:14 2022] GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9 => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:56:14.632705 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-e1e5ac9d-a045-487a-acc9-3e33157812f6 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:14.633259 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-e1e5ac9d-a045-487a-acc9-3e33157812f6 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] [instance: 52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:14.639490 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e1e5ac9d-a045-487a-acc9-3e33157812f6 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:14.640011 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e1e5ac9d-a045-487a-acc9-3e33157812f6 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:14.640402 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e1e5ac9d-a045-487a-acc9-3e33157812f6 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:14.641091 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e1e5ac9d-a045-487a-acc9-3e33157812f6 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:14.641685 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e1e5ac9d-a045-487a-acc9-3e33157812f6 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:14.641968 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e1e5ac9d-a045-487a-acc9-3e33157812f6 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:14.778626 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-e1e5ac9d-a045-487a-acc9-3e33157812f6 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ffc76632a456d9e833381783d4dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed59353a4741cbb901808f7d2210d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:14.787434 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-e1e5ac9d-a045-487a-acc9-3e33157812f6 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] 10.222.0.16 "GET /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0" status: 200 len: 1318 microversion: 2.1 time: 0.158565 Oct 17 03:56:14.788131 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 183/360] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:14 2022] GET /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:56:15.394287 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-170b9069-8e1c-4edb-b612-0d90826c7fba tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:15.395328 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-170b9069-8e1c-4edb-b612-0d90826c7fba tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] [instance: 799ed606-0d4b-42b8-9faa-1d82271135d1] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:15.402417 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-170b9069-8e1c-4edb-b612-0d90826c7fba tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:15.403007 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-170b9069-8e1c-4edb-b612-0d90826c7fba tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:15.403553 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-170b9069-8e1c-4edb-b612-0d90826c7fba tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:15.404342 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-170b9069-8e1c-4edb-b612-0d90826c7fba tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:15.404872 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-170b9069-8e1c-4edb-b612-0d90826c7fba tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:15.405369 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-170b9069-8e1c-4edb-b612-0d90826c7fba tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:15.536796 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-170b9069-8e1c-4edb-b612-0d90826c7fba tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a421a2a8899342b38aa61676f3b7bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7543f344fc54e41836865a828c4754d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:15.546003 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-170b9069-8e1c-4edb-b612-0d90826c7fba tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] 10.222.0.16 "GET /compute/v2.1/servers/799ed606-0d4b-42b8-9faa-1d82271135d1" status: 200 len: 1314 microversion: 2.1 time: 0.158341 Oct 17 03:56:15.546859 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 178/361] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:15 2022] GET /compute/v2.1/servers/799ed606-0d4b-42b8-9faa-1d82271135d1 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:56:15.623689 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [req-15edc37f-ed74-4ad8-9f97-445cc4c6c7be req-a6684503-b64b-44db-a146-b849eb893d96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0", "tag": "5d26d1e1-f05b-4c0a-9fb4-366627caaf10"}]} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:56:15.637186 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-348fa26c-c50b-4825-b713-62c88a856624 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:15.638234 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-348fa26c-c50b-4825-b713-62c88a856624 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 57546995-2ef9-4773-a47a-13cbd2a831a9] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:15.644344 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-348fa26c-c50b-4825-b713-62c88a856624 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:15.644840 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-348fa26c-c50b-4825-b713-62c88a856624 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:15.645274 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-348fa26c-c50b-4825-b713-62c88a856624 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:15.645610 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-15edc37f-ed74-4ad8-9f97-445cc4c6c7be req-a6684503-b64b-44db-a146-b849eb893d96 service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:15.645971 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-348fa26c-c50b-4825-b713-62c88a856624 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:15.646102 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-15edc37f-ed74-4ad8-9f97-445cc4c6c7be req-a6684503-b64b-44db-a146-b849eb893d96 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:15.646425 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-348fa26c-c50b-4825-b713-62c88a856624 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:15.646543 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-15edc37f-ed74-4ad8-9f97-445cc4c6c7be req-a6684503-b64b-44db-a146-b849eb893d96 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:15.646850 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-348fa26c-c50b-4825-b713-62c88a856624 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:15.657957 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.compute.server_external_events [req-15edc37f-ed74-4ad8-9f97-445cc4c6c7be req-a6684503-b64b-44db-a146-b849eb893d96 service nova] Creating event network-changed:5d26d1e1-f05b-4c0a-9fb4-366627caaf10 for instance 52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0 on hv-cinder-81558 Oct 17 03:56:15.662995 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [req-15edc37f-ed74-4ad8-9f97-445cc4c6c7be req-a6684503-b64b-44db-a146-b849eb893d96 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046269 Oct 17 03:56:15.664138 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 184/362] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 03:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:56:15.813011 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-aa5347e5-70c7-417f-a9b6-db9aaa7ea3f5 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:15.813946 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-aa5347e5-70c7-417f-a9b6-db9aaa7ea3f5 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] [instance: 52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:15.814062 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-348fa26c-c50b-4825-b713-62c88a856624 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:15.821965 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-aa5347e5-70c7-417f-a9b6-db9aaa7ea3f5 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:15.825452 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-348fa26c-c50b-4825-b713-62c88a856624 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9" status: 200 len: 1371 microversion: 2.1 time: 0.189347 Oct 17 03:56:15.825562 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-aa5347e5-70c7-417f-a9b6-db9aaa7ea3f5 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:15.825562 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-aa5347e5-70c7-417f-a9b6-db9aaa7ea3f5 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:15.825732 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 179/363] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:15 2022] GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9 => generated 1371 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:56:15.825812 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-aa5347e5-70c7-417f-a9b6-db9aaa7ea3f5 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:15.825812 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-aa5347e5-70c7-417f-a9b6-db9aaa7ea3f5 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:15.825812 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-aa5347e5-70c7-417f-a9b6-db9aaa7ea3f5 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:15.983043 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-aa5347e5-70c7-417f-a9b6-db9aaa7ea3f5 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ffc76632a456d9e833381783d4dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed59353a4741cbb901808f7d2210d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:15.991234 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-aa5347e5-70c7-417f-a9b6-db9aaa7ea3f5 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] 10.222.0.16 "GET /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0" status: 200 len: 1318 microversion: 2.1 time: 0.183520 Oct 17 03:56:15.991817 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 185/364] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:15 2022] GET /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0 => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:56:16.569700 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-88869ab1-e099-42ed-b7c7-608996dbb828 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:16.570301 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-88869ab1-e099-42ed-b7c7-608996dbb828 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] [instance: 799ed606-0d4b-42b8-9faa-1d82271135d1] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:16.577305 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-88869ab1-e099-42ed-b7c7-608996dbb828 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:16.577799 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-88869ab1-e099-42ed-b7c7-608996dbb828 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:16.578230 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-88869ab1-e099-42ed-b7c7-608996dbb828 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:16.578931 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-88869ab1-e099-42ed-b7c7-608996dbb828 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:16.579416 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-88869ab1-e099-42ed-b7c7-608996dbb828 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:16.580019 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-88869ab1-e099-42ed-b7c7-608996dbb828 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:16.736679 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-88869ab1-e099-42ed-b7c7-608996dbb828 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a421a2a8899342b38aa61676f3b7bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7543f344fc54e41836865a828c4754d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:16.752343 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-88869ab1-e099-42ed-b7c7-608996dbb828 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] 10.222.0.16 "GET /compute/v2.1/servers/799ed606-0d4b-42b8-9faa-1d82271135d1" status: 200 len: 1314 microversion: 2.1 time: 0.186417 Oct 17 03:56:16.753308 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 180/365] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:16 2022] GET /compute/v2.1/servers/799ed606-0d4b-42b8-9faa-1d82271135d1 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:56:16.847024 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-88b14317-2f9b-4e09-8cdc-eac5c3f6dbe8 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:16.848677 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-88b14317-2f9b-4e09-8cdc-eac5c3f6dbe8 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 57546995-2ef9-4773-a47a-13cbd2a831a9] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:16.857411 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-88b14317-2f9b-4e09-8cdc-eac5c3f6dbe8 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:16.858342 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-88b14317-2f9b-4e09-8cdc-eac5c3f6dbe8 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:16.858954 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-88b14317-2f9b-4e09-8cdc-eac5c3f6dbe8 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:16.859912 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-88b14317-2f9b-4e09-8cdc-eac5c3f6dbe8 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:16.860389 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-88b14317-2f9b-4e09-8cdc-eac5c3f6dbe8 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:16.860825 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-88b14317-2f9b-4e09-8cdc-eac5c3f6dbe8 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:17.014490 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-58aef63a-c042-455c-be0d-27fcab76f7ee tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:17.015231 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-58aef63a-c042-455c-be0d-27fcab76f7ee tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] [instance: 52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:17.017281 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_cell0:SELECT=2 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:56:17.022094 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-58aef63a-c042-455c-be0d-27fcab76f7ee tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:17.022584 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-58aef63a-c042-455c-be0d-27fcab76f7ee tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:17.023016 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-58aef63a-c042-455c-be0d-27fcab76f7ee tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:17.024064 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-58aef63a-c042-455c-be0d-27fcab76f7ee tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:17.024556 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-58aef63a-c042-455c-be0d-27fcab76f7ee tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:17.024982 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-58aef63a-c042-455c-be0d-27fcab76f7ee tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:17.029924 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_cell1:SELECT=100 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:56:17.087132 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-88b14317-2f9b-4e09-8cdc-eac5c3f6dbe8 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:17.096969 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-88b14317-2f9b-4e09-8cdc-eac5c3f6dbe8 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9" status: 200 len: 1565 microversion: 2.1 time: 0.254662 Oct 17 03:56:17.098877 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 186/366] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:16 2022] GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9 => generated 1565 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:56:17.128845 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-30a75cec-af78-4654-af65-88484399b7f3 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:17.129321 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-30a75cec-af78-4654-af65-88484399b7f3 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 57546995-2ef9-4773-a47a-13cbd2a831a9] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:17.143812 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-30a75cec-af78-4654-af65-88484399b7f3 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:17.144387 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-30a75cec-af78-4654-af65-88484399b7f3 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:17.145482 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-30a75cec-af78-4654-af65-88484399b7f3 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:17.146200 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-30a75cec-af78-4654-af65-88484399b7f3 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:17.147009 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-30a75cec-af78-4654-af65-88484399b7f3 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:17.147470 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-30a75cec-af78-4654-af65-88484399b7f3 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:17.205074 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-58aef63a-c042-455c-be0d-27fcab76f7ee tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ffc76632a456d9e833381783d4dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed59353a4741cbb901808f7d2210d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:17.213264 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-58aef63a-c042-455c-be0d-27fcab76f7ee tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] 10.222.0.16 "GET /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0" status: 200 len: 1318 microversion: 2.1 time: 0.203274 Oct 17 03:56:17.213901 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 181/367] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:17 2022] GET /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0 => generated 1318 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:56:17.246336 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-30a75cec-af78-4654-af65-88484399b7f3 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.122095 Oct 17 03:56:17.247139 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 187/368] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Oct 17 03:56:17 2022] GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9/os-interface => generated 285 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:56:17.778567 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-f168c03f-0d6b-42e3-9e04-b4d968e2aecb tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:17.779219 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-f168c03f-0d6b-42e3-9e04-b4d968e2aecb tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] [instance: 799ed606-0d4b-42b8-9faa-1d82271135d1] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:17.785595 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f168c03f-0d6b-42e3-9e04-b4d968e2aecb tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:17.786081 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f168c03f-0d6b-42e3-9e04-b4d968e2aecb tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:17.786516 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f168c03f-0d6b-42e3-9e04-b4d968e2aecb tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:17.787240 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f168c03f-0d6b-42e3-9e04-b4d968e2aecb tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:17.787686 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f168c03f-0d6b-42e3-9e04-b4d968e2aecb tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:17.788294 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f168c03f-0d6b-42e3-9e04-b4d968e2aecb tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:17.923978 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-f168c03f-0d6b-42e3-9e04-b4d968e2aecb tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a421a2a8899342b38aa61676f3b7bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7543f344fc54e41836865a828c4754d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:17.932152 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-f168c03f-0d6b-42e3-9e04-b4d968e2aecb tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] 10.222.0.16 "GET /compute/v2.1/servers/799ed606-0d4b-42b8-9faa-1d82271135d1" status: 200 len: 1314 microversion: 2.1 time: 0.157289 Oct 17 03:56:17.932750 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 182/369] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:17 2022] GET /compute/v2.1/servers/799ed606-0d4b-42b8-9faa-1d82271135d1 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:56:18.237915 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-d010e33d-cd8f-4c7d-94c9-f319d8e3ba02 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:18.238540 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-d010e33d-cd8f-4c7d-94c9-f319d8e3ba02 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] [instance: 52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:18.244651 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d010e33d-cd8f-4c7d-94c9-f319d8e3ba02 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:18.248648 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d010e33d-cd8f-4c7d-94c9-f319d8e3ba02 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:18.248648 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d010e33d-cd8f-4c7d-94c9-f319d8e3ba02 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:18.248648 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d010e33d-cd8f-4c7d-94c9-f319d8e3ba02 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:18.248648 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d010e33d-cd8f-4c7d-94c9-f319d8e3ba02 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:18.248996 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d010e33d-cd8f-4c7d-94c9-f319d8e3ba02 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:18.457483 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-d010e33d-cd8f-4c7d-94c9-f319d8e3ba02 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ffc76632a456d9e833381783d4dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed59353a4741cbb901808f7d2210d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:18.472535 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-d010e33d-cd8f-4c7d-94c9-f319d8e3ba02 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] 10.222.0.16 "GET /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0" status: 200 len: 1318 microversion: 2.1 time: 0.239139 Oct 17 03:56:18.473645 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 188/370] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:18 2022] GET /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0 => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:56:18.610336 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [req-d82c9033-170d-426c-8519-a919c25f8db8 req-64300a78-fc96-43ae-af79-2ca1e55841b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57546995-2ef9-4773-a47a-13cbd2a831a9", "tag": "6d4fd674-8999-42dd-8bcb-abfcc7aaca39"}]} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:56:18.619956 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-d82c9033-170d-426c-8519-a919c25f8db8 req-64300a78-fc96-43ae-af79-2ca1e55841b7 service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:18.620612 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-d82c9033-170d-426c-8519-a919c25f8db8 req-64300a78-fc96-43ae-af79-2ca1e55841b7 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:18.621047 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-d82c9033-170d-426c-8519-a919c25f8db8 req-64300a78-fc96-43ae-af79-2ca1e55841b7 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:18.632285 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.compute.server_external_events [req-d82c9033-170d-426c-8519-a919c25f8db8 req-64300a78-fc96-43ae-af79-2ca1e55841b7 service nova] Creating event network-changed:6d4fd674-8999-42dd-8bcb-abfcc7aaca39 for instance 57546995-2ef9-4773-a47a-13cbd2a831a9 on hv-cinder-81558 Oct 17 03:56:18.638263 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [req-d82c9033-170d-426c-8519-a919c25f8db8 req-64300a78-fc96-43ae-af79-2ca1e55841b7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031765 Oct 17 03:56:18.638887 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 183/371] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 03:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:56:18.958624 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-91f4d989-014f-467e-9519-c31ad55ff4be tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:18.959713 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-91f4d989-014f-467e-9519-c31ad55ff4be tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] [instance: 799ed606-0d4b-42b8-9faa-1d82271135d1] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:18.967647 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-91f4d989-014f-467e-9519-c31ad55ff4be tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:18.969060 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-91f4d989-014f-467e-9519-c31ad55ff4be tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:18.969686 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-91f4d989-014f-467e-9519-c31ad55ff4be tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:18.970621 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-91f4d989-014f-467e-9519-c31ad55ff4be tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:18.971312 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-91f4d989-014f-467e-9519-c31ad55ff4be tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:18.971944 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-91f4d989-014f-467e-9519-c31ad55ff4be tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:19.133273 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [req-12487a36-a5c5-4df4-9e69-b4bafd3ac5b8 req-87fef896-384f-47cf-8b38-bd6fb5973d4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "799ed606-0d4b-42b8-9faa-1d82271135d1", "name": "network-vif-plugged", "status": "completed", "tag": "89532930-a662-4754-ba36-6a728a041f10"}]} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:56:19.161603 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-12487a36-a5c5-4df4-9e69-b4bafd3ac5b8 req-87fef896-384f-47cf-8b38-bd6fb5973d4b service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:19.162097 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-12487a36-a5c5-4df4-9e69-b4bafd3ac5b8 req-87fef896-384f-47cf-8b38-bd6fb5973d4b service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:19.162525 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-12487a36-a5c5-4df4-9e69-b4bafd3ac5b8 req-87fef896-384f-47cf-8b38-bd6fb5973d4b service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:19.185867 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.compute.server_external_events [req-12487a36-a5c5-4df4-9e69-b4bafd3ac5b8 req-87fef896-384f-47cf-8b38-bd6fb5973d4b service nova] Creating event network-vif-plugged:89532930-a662-4754-ba36-6a728a041f10 for instance 799ed606-0d4b-42b8-9faa-1d82271135d1 on hv-cinder-81558 Oct 17 03:56:19.200351 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [req-12487a36-a5c5-4df4-9e69-b4bafd3ac5b8 req-87fef896-384f-47cf-8b38-bd6fb5973d4b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068272 Oct 17 03:56:19.202253 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 184/372] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 03:56:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 03:56:19.218630 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-91f4d989-014f-467e-9519-c31ad55ff4be tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a421a2a8899342b38aa61676f3b7bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7543f344fc54e41836865a828c4754d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:19.232133 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-91f4d989-014f-467e-9519-c31ad55ff4be tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] 10.222.0.16 "GET /compute/v2.1/servers/799ed606-0d4b-42b8-9faa-1d82271135d1" status: 200 len: 1314 microversion: 2.1 time: 0.278756 Oct 17 03:56:19.233237 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 189/373] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:18 2022] GET /compute/v2.1/servers/799ed606-0d4b-42b8-9faa-1d82271135d1 => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:56:19.497319 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-5746b944-1384-4006-b0b4-e4a8d9ab0013 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:19.498028 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-5746b944-1384-4006-b0b4-e4a8d9ab0013 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] [instance: 52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:19.504184 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-5746b944-1384-4006-b0b4-e4a8d9ab0013 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:19.504674 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-5746b944-1384-4006-b0b4-e4a8d9ab0013 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:19.505113 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-5746b944-1384-4006-b0b4-e4a8d9ab0013 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:19.505811 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-5746b944-1384-4006-b0b4-e4a8d9ab0013 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:19.506263 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-5746b944-1384-4006-b0b4-e4a8d9ab0013 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:19.506718 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-5746b944-1384-4006-b0b4-e4a8d9ab0013 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:19.662765 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-5746b944-1384-4006-b0b4-e4a8d9ab0013 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ffc76632a456d9e833381783d4dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed59353a4741cbb901808f7d2210d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:19.671313 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-5746b944-1384-4006-b0b4-e4a8d9ab0013 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] 10.222.0.16 "GET /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0" status: 200 len: 1318 microversion: 2.1 time: 0.178261 Oct 17 03:56:19.671907 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 185/374] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:19 2022] GET /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0 => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:56:20.255132 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-395f18b5-8a44-42e2-8811-47d9c6674995 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:20.255780 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-395f18b5-8a44-42e2-8811-47d9c6674995 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] [instance: 799ed606-0d4b-42b8-9faa-1d82271135d1] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:20.258361 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_cell0:SELECT=2 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:56:20.264522 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-395f18b5-8a44-42e2-8811-47d9c6674995 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:20.265022 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-395f18b5-8a44-42e2-8811-47d9c6674995 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:20.265462 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-395f18b5-8a44-42e2-8811-47d9c6674995 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:20.266222 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-395f18b5-8a44-42e2-8811-47d9c6674995 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:20.266678 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-395f18b5-8a44-42e2-8811-47d9c6674995 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:20.267132 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-395f18b5-8a44-42e2-8811-47d9c6674995 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:20.395609 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-395f18b5-8a44-42e2-8811-47d9c6674995 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a421a2a8899342b38aa61676f3b7bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7543f344fc54e41836865a828c4754d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:20.405395 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-395f18b5-8a44-42e2-8811-47d9c6674995 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] 10.222.0.16 "GET /compute/v2.1/servers/799ed606-0d4b-42b8-9faa-1d82271135d1" status: 200 len: 1314 microversion: 2.1 time: 0.153658 Oct 17 03:56:20.408007 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 190/375] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:20 2022] GET /compute/v2.1/servers/799ed606-0d4b-42b8-9faa-1d82271135d1 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:56:20.694773 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-d62cc8aa-e4ef-4679-a64f-26c207edc01c tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:20.695444 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-d62cc8aa-e4ef-4679-a64f-26c207edc01c tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] [instance: 52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:20.698898 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_cell0:SELECT=24 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:56:20.703120 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d62cc8aa-e4ef-4679-a64f-26c207edc01c tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:20.703633 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d62cc8aa-e4ef-4679-a64f-26c207edc01c tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:20.704070 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d62cc8aa-e4ef-4679-a64f-26c207edc01c tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:20.704864 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d62cc8aa-e4ef-4679-a64f-26c207edc01c tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:20.705326 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d62cc8aa-e4ef-4679-a64f-26c207edc01c tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:20.705753 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d62cc8aa-e4ef-4679-a64f-26c207edc01c tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:20.837842 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-d62cc8aa-e4ef-4679-a64f-26c207edc01c tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ffc76632a456d9e833381783d4dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed59353a4741cbb901808f7d2210d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:20.845453 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-d62cc8aa-e4ef-4679-a64f-26c207edc01c tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] 10.222.0.16 "GET /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0" status: 200 len: 1318 microversion: 2.1 time: 0.154553 Oct 17 03:56:20.846358 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 186/376] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:20 2022] GET /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:56:21.428396 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-1576c969-4ee5-4abf-a672-26f4f3179a74 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:21.429007 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-1576c969-4ee5-4abf-a672-26f4f3179a74 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] [instance: 799ed606-0d4b-42b8-9faa-1d82271135d1] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:21.431481 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_cell0:SELECT=12 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:56:21.436811 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1576c969-4ee5-4abf-a672-26f4f3179a74 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:21.437297 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1576c969-4ee5-4abf-a672-26f4f3179a74 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:21.437735 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1576c969-4ee5-4abf-a672-26f4f3179a74 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:21.438434 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1576c969-4ee5-4abf-a672-26f4f3179a74 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:21.438896 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1576c969-4ee5-4abf-a672-26f4f3179a74 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:21.439357 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1576c969-4ee5-4abf-a672-26f4f3179a74 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:21.580344 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-1576c969-4ee5-4abf-a672-26f4f3179a74 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a421a2a8899342b38aa61676f3b7bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7543f344fc54e41836865a828c4754d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:21.589058 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-1576c969-4ee5-4abf-a672-26f4f3179a74 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] 10.222.0.16 "GET /compute/v2.1/servers/799ed606-0d4b-42b8-9faa-1d82271135d1" status: 200 len: 1314 microversion: 2.1 time: 0.164457 Oct 17 03:56:21.589648 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 191/377] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:21 2022] GET /compute/v2.1/servers/799ed606-0d4b-42b8-9faa-1d82271135d1 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:56:21.859829 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-64df1ea7-b3a3-4d4f-9c0a-620fb5b8f067 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:21.860386 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-64df1ea7-b3a3-4d4f-9c0a-620fb5b8f067 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:21.867820 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-64df1ea7-b3a3-4d4f-9c0a-620fb5b8f067 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:21.868469 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-64df1ea7-b3a3-4d4f-9c0a-620fb5b8f067 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:21.868896 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-64df1ea7-b3a3-4d4f-9c0a-620fb5b8f067 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:21.869595 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-64df1ea7-b3a3-4d4f-9c0a-620fb5b8f067 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:21.870044 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-64df1ea7-b3a3-4d4f-9c0a-620fb5b8f067 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:21.870463 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-64df1ea7-b3a3-4d4f-9c0a-620fb5b8f067 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:21.870559 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-8b06b164-604b-446e-864c-53fe849dd8f1 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:21.871125 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-8b06b164-604b-446e-864c-53fe849dd8f1 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] [instance: 52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:21.873061 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:56:21.878313 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8b06b164-604b-446e-864c-53fe849dd8f1 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:21.878818 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8b06b164-604b-446e-864c-53fe849dd8f1 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:21.879278 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8b06b164-604b-446e-864c-53fe849dd8f1 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:21.884532 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8b06b164-604b-446e-864c-53fe849dd8f1 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:21.884532 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8b06b164-604b-446e-864c-53fe849dd8f1 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:21.884532 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8b06b164-604b-446e-864c-53fe849dd8f1 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:21.894450 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-64df1ea7-b3a3-4d4f-9c0a-620fb5b8f067 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf/ips" status: 200 len: 152 microversion: 2.20 time: 0.039191 Oct 17 03:56:21.895078 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 187/378] 10.222.0.16 () {60 vars in 1289 bytes} [Mon Oct 17 03:56:21 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf/ips => generated 152 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 03:56:22.023510 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-8b06b164-604b-446e-864c-53fe849dd8f1 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ffc76632a456d9e833381783d4dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed59353a4741cbb901808f7d2210d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:22.036769 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-8b06b164-604b-446e-864c-53fe849dd8f1 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] 10.222.0.16 "GET /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0" status: 200 len: 1318 microversion: 2.1 time: 0.171561 Oct 17 03:56:22.037619 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 192/379] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:21 2022] GET /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:56:22.610974 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-612db3b0-415f-41f5-9b08-c06e179a0310 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:22.611642 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-612db3b0-415f-41f5-9b08-c06e179a0310 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] [instance: 799ed606-0d4b-42b8-9faa-1d82271135d1] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:22.617649 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-612db3b0-415f-41f5-9b08-c06e179a0310 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:22.618136 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-612db3b0-415f-41f5-9b08-c06e179a0310 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:22.618567 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-612db3b0-415f-41f5-9b08-c06e179a0310 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:22.619282 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-612db3b0-415f-41f5-9b08-c06e179a0310 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:22.619825 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-612db3b0-415f-41f5-9b08-c06e179a0310 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:22.620247 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-612db3b0-415f-41f5-9b08-c06e179a0310 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:22.750600 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-612db3b0-415f-41f5-9b08-c06e179a0310 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a421a2a8899342b38aa61676f3b7bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7543f344fc54e41836865a828c4754d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:22.758836 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-612db3b0-415f-41f5-9b08-c06e179a0310 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] 10.222.0.16 "GET /compute/v2.1/servers/799ed606-0d4b-42b8-9faa-1d82271135d1" status: 200 len: 1499 microversion: 2.1 time: 0.151757 Oct 17 03:56:22.759446 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 188/380] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:22 2022] GET /compute/v2.1/servers/799ed606-0d4b-42b8-9faa-1d82271135d1 => generated 1499 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:56:22.888162 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [req-8b7faced-be3f-4520-8838-560168829244 req-36a7ba78-edca-43fc-8de7-8a698cebbb12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0", "name": "network-vif-plugged", "status": "completed", "tag": "5d26d1e1-f05b-4c0a-9fb4-366627caaf10"}]} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:56:22.898500 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-8b7faced-be3f-4520-8838-560168829244 req-36a7ba78-edca-43fc-8de7-8a698cebbb12 service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:22.899014 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-8b7faced-be3f-4520-8838-560168829244 req-36a7ba78-edca-43fc-8de7-8a698cebbb12 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:22.899483 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-8b7faced-be3f-4520-8838-560168829244 req-36a7ba78-edca-43fc-8de7-8a698cebbb12 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:22.910656 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.compute.server_external_events [req-8b7faced-be3f-4520-8838-560168829244 req-36a7ba78-edca-43fc-8de7-8a698cebbb12 service nova] Creating event network-vif-plugged:5d26d1e1-f05b-4c0a-9fb4-366627caaf10 for instance 52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0 on hv-cinder-81558 Oct 17 03:56:22.915325 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [req-8b7faced-be3f-4520-8838-560168829244 req-36a7ba78-edca-43fc-8de7-8a698cebbb12 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031895 Oct 17 03:56:22.915975 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 193/381] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 03:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:56:23.060904 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-3a076660-25e1-441e-91a3-39054a2bcf48 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:23.061505 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-3a076660-25e1-441e-91a3-39054a2bcf48 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] [instance: 52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:23.067901 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-3a076660-25e1-441e-91a3-39054a2bcf48 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:23.068392 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-3a076660-25e1-441e-91a3-39054a2bcf48 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:23.068828 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-3a076660-25e1-441e-91a3-39054a2bcf48 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:23.069526 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-3a076660-25e1-441e-91a3-39054a2bcf48 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:23.069983 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-3a076660-25e1-441e-91a3-39054a2bcf48 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:23.070417 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-3a076660-25e1-441e-91a3-39054a2bcf48 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:23.201853 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-3a076660-25e1-441e-91a3-39054a2bcf48 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ffc76632a456d9e833381783d4dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed59353a4741cbb901808f7d2210d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:23.211700 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-3a076660-25e1-441e-91a3-39054a2bcf48 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] 10.222.0.16 "GET /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0" status: 200 len: 1318 microversion: 2.1 time: 0.153891 Oct 17 03:56:23.211700 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 189/382] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:23 2022] GET /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:56:24.100446 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-8f7ffeec-8be1-4407-96a7-40e8f620f9f8 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:24.101028 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-8f7ffeec-8be1-4407-96a7-40e8f620f9f8 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] [instance: 799ed606-0d4b-42b8-9faa-1d82271135d1] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:24.107164 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8f7ffeec-8be1-4407-96a7-40e8f620f9f8 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:24.107672 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8f7ffeec-8be1-4407-96a7-40e8f620f9f8 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:24.108105 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8f7ffeec-8be1-4407-96a7-40e8f620f9f8 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:24.108790 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8f7ffeec-8be1-4407-96a7-40e8f620f9f8 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:24.109242 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8f7ffeec-8be1-4407-96a7-40e8f620f9f8 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:24.109663 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8f7ffeec-8be1-4407-96a7-40e8f620f9f8 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:24.134597 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-8f7ffeec-8be1-4407-96a7-40e8f620f9f8 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] [instance: 799ed606-0d4b-42b8-9faa-1d82271135d1] Going to try to terminate instance {{(pid=125871) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 03:56:24.232810 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-1ce35bc7-bcd4-4162-a675-0441cb4fc303 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:24.233429 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-1ce35bc7-bcd4-4162-a675-0441cb4fc303 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] [instance: 52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:24.240268 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1ce35bc7-bcd4-4162-a675-0441cb4fc303 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:24.240873 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1ce35bc7-bcd4-4162-a675-0441cb4fc303 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:24.241342 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1ce35bc7-bcd4-4162-a675-0441cb4fc303 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:24.242042 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1ce35bc7-bcd4-4162-a675-0441cb4fc303 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:24.242498 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1ce35bc7-bcd4-4162-a675-0441cb4fc303 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:24.242923 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1ce35bc7-bcd4-4162-a675-0441cb4fc303 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:24.358978 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-8f7ffeec-8be1-4407-96a7-40e8f620f9f8 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] 10.222.0.16 "DELETE /compute/v2.1/servers/799ed606-0d4b-42b8-9faa-1d82271135d1" status: 204 len: 0 microversion: 2.1 time: 0.262878 Oct 17 03:56:24.359667 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 194/383] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 17 03:56:24 2022] DELETE /compute/v2.1/servers/799ed606-0d4b-42b8-9faa-1d82271135d1 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 03:56:24.368155 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-ae91bdb6-a3fa-45e9-875d-ade8ce7aa096 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:24.370002 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-ae91bdb6-a3fa-45e9-875d-ade8ce7aa096 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] [instance: 799ed606-0d4b-42b8-9faa-1d82271135d1] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:24.374155 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-1ce35bc7-bcd4-4162-a675-0441cb4fc303 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ffc76632a456d9e833381783d4dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed59353a4741cbb901808f7d2210d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:24.375505 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ae91bdb6-a3fa-45e9-875d-ade8ce7aa096 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:24.375993 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ae91bdb6-a3fa-45e9-875d-ade8ce7aa096 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:24.376425 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ae91bdb6-a3fa-45e9-875d-ade8ce7aa096 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:24.377125 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ae91bdb6-a3fa-45e9-875d-ade8ce7aa096 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:24.377589 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ae91bdb6-a3fa-45e9-875d-ade8ce7aa096 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:24.378000 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ae91bdb6-a3fa-45e9-875d-ade8ce7aa096 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:24.381948 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-1ce35bc7-bcd4-4162-a675-0441cb4fc303 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] 10.222.0.16 "GET /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0" status: 200 len: 1318 microversion: 2.1 time: 0.153227 Oct 17 03:56:24.382510 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 190/384] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:24 2022] GET /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:56:24.517050 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-ae91bdb6-a3fa-45e9-875d-ade8ce7aa096 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a421a2a8899342b38aa61676f3b7bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7543f344fc54e41836865a828c4754d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:24.524779 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-ae91bdb6-a3fa-45e9-875d-ade8ce7aa096 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] 10.222.0.16 "GET /compute/v2.1/servers/799ed606-0d4b-42b8-9faa-1d82271135d1" status: 200 len: 1505 microversion: 2.1 time: 0.160761 Oct 17 03:56:24.525338 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 195/385] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:24 2022] GET /compute/v2.1/servers/799ed606-0d4b-42b8-9faa-1d82271135d1 => generated 1505 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:56:25.406120 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-61ea9b2b-32e9-435c-bef5-2e1cf9e2e37c tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:25.406734 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-61ea9b2b-32e9-435c-bef5-2e1cf9e2e37c tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] [instance: 52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:25.413518 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-61ea9b2b-32e9-435c-bef5-2e1cf9e2e37c tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:25.414002 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-61ea9b2b-32e9-435c-bef5-2e1cf9e2e37c tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:25.414432 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-61ea9b2b-32e9-435c-bef5-2e1cf9e2e37c tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:25.415397 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-61ea9b2b-32e9-435c-bef5-2e1cf9e2e37c tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:25.415855 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-61ea9b2b-32e9-435c-bef5-2e1cf9e2e37c tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:25.416278 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-61ea9b2b-32e9-435c-bef5-2e1cf9e2e37c tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:25.542552 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-61ea9b2b-32e9-435c-bef5-2e1cf9e2e37c tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ffc76632a456d9e833381783d4dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed59353a4741cbb901808f7d2210d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:25.547071 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-5287bc4f-02a8-4c16-88b5-8f2d452d8fa5 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:25.547721 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-5287bc4f-02a8-4c16-88b5-8f2d452d8fa5 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] [instance: 799ed606-0d4b-42b8-9faa-1d82271135d1] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:25.550405 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-61ea9b2b-32e9-435c-bef5-2e1cf9e2e37c tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] 10.222.0.16 "GET /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0" status: 200 len: 1318 microversion: 2.1 time: 0.148893 Oct 17 03:56:25.551125 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 191/386] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:25 2022] GET /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:56:25.554305 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5287bc4f-02a8-4c16-88b5-8f2d452d8fa5 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:25.554794 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5287bc4f-02a8-4c16-88b5-8f2d452d8fa5 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:25.555259 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5287bc4f-02a8-4c16-88b5-8f2d452d8fa5 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:25.555954 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5287bc4f-02a8-4c16-88b5-8f2d452d8fa5 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:25.556404 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5287bc4f-02a8-4c16-88b5-8f2d452d8fa5 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:25.561602 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5287bc4f-02a8-4c16-88b5-8f2d452d8fa5 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:25.687277 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-5287bc4f-02a8-4c16-88b5-8f2d452d8fa5 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a421a2a8899342b38aa61676f3b7bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7543f344fc54e41836865a828c4754d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:25.694793 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-5287bc4f-02a8-4c16-88b5-8f2d452d8fa5 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] 10.222.0.16 "GET /compute/v2.1/servers/799ed606-0d4b-42b8-9faa-1d82271135d1" status: 200 len: 1505 microversion: 2.1 time: 0.151617 Oct 17 03:56:25.695385 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 196/387] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:25 2022] GET /compute/v2.1/servers/799ed606-0d4b-42b8-9faa-1d82271135d1 => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:56:26.576066 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-b9fae4f0-6789-4db7-9bf1-3c844af61af2 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:26.576624 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-b9fae4f0-6789-4db7-9bf1-3c844af61af2 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] [instance: 52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:26.583105 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b9fae4f0-6789-4db7-9bf1-3c844af61af2 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:26.583619 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b9fae4f0-6789-4db7-9bf1-3c844af61af2 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:26.584044 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b9fae4f0-6789-4db7-9bf1-3c844af61af2 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:26.584729 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b9fae4f0-6789-4db7-9bf1-3c844af61af2 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:26.585173 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b9fae4f0-6789-4db7-9bf1-3c844af61af2 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:26.585699 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b9fae4f0-6789-4db7-9bf1-3c844af61af2 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:26.717124 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-b9fae4f0-6789-4db7-9bf1-3c844af61af2 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ffc76632a456d9e833381783d4dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed59353a4741cbb901808f7d2210d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:26.718002 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-875449e5-1e19-436d-90bd-a42c2c84c7dd tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:26.718638 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-875449e5-1e19-436d-90bd-a42c2c84c7dd tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] [instance: 799ed606-0d4b-42b8-9faa-1d82271135d1] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:26.724825 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-875449e5-1e19-436d-90bd-a42c2c84c7dd tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:26.725309 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-875449e5-1e19-436d-90bd-a42c2c84c7dd tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:26.725549 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-b9fae4f0-6789-4db7-9bf1-3c844af61af2 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] 10.222.0.16 "GET /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0" status: 200 len: 1507 microversion: 2.1 time: 0.155369 Oct 17 03:56:26.725748 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-875449e5-1e19-436d-90bd-a42c2c84c7dd tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:26.726203 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 192/388] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:26 2022] GET /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0 => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:56:26.726548 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-875449e5-1e19-436d-90bd-a42c2c84c7dd tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:26.727010 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-875449e5-1e19-436d-90bd-a42c2c84c7dd tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:26.727616 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-875449e5-1e19-436d-90bd-a42c2c84c7dd tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:26.851382 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-0db28fce-237e-4f57-9f99-7ee7f9630dad tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:56:26.852760 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-0db28fce-237e-4f57-9f99-7ee7f9630dad tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:26.859835 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0db28fce-237e-4f57-9f99-7ee7f9630dad tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:26.860316 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0db28fce-237e-4f57-9f99-7ee7f9630dad tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:26.860938 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0db28fce-237e-4f57-9f99-7ee7f9630dad tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:26.861665 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0db28fce-237e-4f57-9f99-7ee7f9630dad tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:26.862501 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0db28fce-237e-4f57-9f99-7ee7f9630dad tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:26.863025 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0db28fce-237e-4f57-9f99-7ee7f9630dad tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:26.864114 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-875449e5-1e19-436d-90bd-a42c2c84c7dd tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a421a2a8899342b38aa61676f3b7bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7543f344fc54e41836865a828c4754d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:26.868023 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:56:26.873628 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-875449e5-1e19-436d-90bd-a42c2c84c7dd tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] 10.222.0.16 "GET /compute/v2.1/servers/799ed606-0d4b-42b8-9faa-1d82271135d1" status: 200 len: 1505 microversion: 2.1 time: 0.159449 Oct 17 03:56:26.874432 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 197/389] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:26 2022] GET /compute/v2.1/servers/799ed606-0d4b-42b8-9faa-1d82271135d1 => generated 1505 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:56:26.887393 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.objects.instance [None req-0db28fce-237e-4f57-9f99-7ee7f9630dad tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lazy-loading 'flavor' on Instance uuid 0982f171-946d-4314-89f2-c139e6bf9adf {{(pid=125872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:56:27.354740 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-311f8df1-976c-4ded-8c46-6f318ffc865b tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1539039545", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-369098111", "security_groups": [{"name": "tempest-secgroup-smoke-58863547"}], "networks": [{"uuid": "9719333f-79d4-4018-8eef-e21c6c675131"}], "block_device_mapping_v2": [{"uuid": "89a4b183-37fd-40e8-a136-a69c1a500455", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:56:27.372662 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-0db28fce-237e-4f57-9f99-7ee7f9630dad tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "POST /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf/action" status: 202 len: 0 microversion: 2.20 time: 0.521345 Oct 17 03:56:27.372662 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 193/390] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Oct 17 03:56:26 2022] POST /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf/action => generated 0 bytes in 523 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 03:56:27.378050 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-c5bae7d5-85be-49ef-a02c-4ed1a1979a5a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:27.378762 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-c5bae7d5-85be-49ef-a02c-4ed1a1979a5a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:27.386804 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c5bae7d5-85be-49ef-a02c-4ed1a1979a5a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:27.387324 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c5bae7d5-85be-49ef-a02c-4ed1a1979a5a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:27.387824 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c5bae7d5-85be-49ef-a02c-4ed1a1979a5a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:27.388542 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c5bae7d5-85be-49ef-a02c-4ed1a1979a5a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:27.388998 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c5bae7d5-85be-49ef-a02c-4ed1a1979a5a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:27.389583 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c5bae7d5-85be-49ef-a02c-4ed1a1979a5a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:27.551564 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.network.neutron [None req-311f8df1-976c-4ded-8c46-6f318ffc865b tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] validate_networks() for [('9719333f-79d4-4018-8eef-e21c6c675131', None, None, None, None, None)] {{(pid=125871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 03:56:27.569066 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-c5bae7d5-85be-49ef-a02c-4ed1a1979a5a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:27.580864 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-c5bae7d5-85be-49ef-a02c-4ed1a1979a5a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:27.582388 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-c5bae7d5-85be-49ef-a02c-4ed1a1979a5a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:27.583616 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-c5bae7d5-85be-49ef-a02c-4ed1a1979a5a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1723 microversion: 2.20 time: 0.209649 Oct 17 03:56:27.591894 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 194/391] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:56:27 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1723 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:56:27.906454 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-3446b6f9-d652-40b9-bff0-e13a9daaa27a tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:27.907192 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-3446b6f9-d652-40b9-bff0-e13a9daaa27a tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] [instance: 799ed606-0d4b-42b8-9faa-1d82271135d1] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:27.916962 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-3446b6f9-d652-40b9-bff0-e13a9daaa27a tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:27.916962 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-3446b6f9-d652-40b9-bff0-e13a9daaa27a tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:27.916962 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-3446b6f9-d652-40b9-bff0-e13a9daaa27a tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:27.916962 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-3446b6f9-d652-40b9-bff0-e13a9daaa27a tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:27.917410 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-3446b6f9-d652-40b9-bff0-e13a9daaa27a tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:27.917410 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-3446b6f9-d652-40b9-bff0-e13a9daaa27a tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:27.994464 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-3446b6f9-d652-40b9-bff0-e13a9daaa27a tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a421a2a8899342b38aa61676f3b7bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7543f344fc54e41836865a828c4754d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:28.004101 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-3446b6f9-d652-40b9-bff0-e13a9daaa27a tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] 10.222.0.16 "GET /compute/v2.1/servers/799ed606-0d4b-42b8-9faa-1d82271135d1" status: 200 len: 1463 microversion: 2.1 time: 0.107482 Oct 17 03:56:28.004762 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 195/392] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:27 2022] GET /compute/v2.1/servers/799ed606-0d4b-42b8-9faa-1d82271135d1 => generated 1463 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:56:28.013146 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [req-1ae15c96-205e-490f-af46-e3b6202359c8 req-8f91d7ac-3deb-4424-a383-b69b054f5463 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "799ed606-0d4b-42b8-9faa-1d82271135d1", "name": "network-vif-deleted", "tag": "89532930-a662-4754-ba36-6a728a041f10"}]} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:56:28.026233 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-1ae15c96-205e-490f-af46-e3b6202359c8 req-8f91d7ac-3deb-4424-a383-b69b054f5463 service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:28.026711 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-1ae15c96-205e-490f-af46-e3b6202359c8 req-8f91d7ac-3deb-4424-a383-b69b054f5463 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:28.027160 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-1ae15c96-205e-490f-af46-e3b6202359c8 req-8f91d7ac-3deb-4424-a383-b69b054f5463 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:28.038255 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.compute.server_external_events [req-1ae15c96-205e-490f-af46-e3b6202359c8 req-8f91d7ac-3deb-4424-a383-b69b054f5463 service nova] Creating event network-vif-deleted:89532930-a662-4754-ba36-6a728a041f10 for instance 799ed606-0d4b-42b8-9faa-1d82271135d1 on hv-cinder-81558 Oct 17 03:56:28.044133 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [req-1ae15c96-205e-490f-af46-e3b6202359c8 req-8f91d7ac-3deb-4424-a383-b69b054f5463 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034775 Oct 17 03:56:28.044939 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 196/393] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 03:56:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:56:28.077232 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.virt.hardware [None req-311f8df1-976c-4ded-8c46-6f318ffc865b tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Flavor limits 0:0:0 {{(pid=125871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 03:56:28.077787 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.virt.hardware [None req-311f8df1-976c-4ded-8c46-6f318ffc865b tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Image limits 0:0:0 {{(pid=125871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 03:56:28.078545 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.virt.hardware [None req-311f8df1-976c-4ded-8c46-6f318ffc865b tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Flavor pref 0:0:0 {{(pid=125871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 03:56:28.079196 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.virt.hardware [None req-311f8df1-976c-4ded-8c46-6f318ffc865b tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Image pref 0:0:0 {{(pid=125871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 03:56:28.079728 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.virt.hardware [None req-311f8df1-976c-4ded-8c46-6f318ffc865b tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 03:56:28.090473 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-311f8df1-976c-4ded-8c46-6f318ffc865b tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:28.091111 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-311f8df1-976c-4ded-8c46-6f318ffc865b tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:28.091636 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-311f8df1-976c-4ded-8c46-6f318ffc865b tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:28.092547 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-311f8df1-976c-4ded-8c46-6f318ffc865b tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:28.093013 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-311f8df1-976c-4ded-8c46-6f318ffc865b tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:28.093449 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-311f8df1-976c-4ded-8c46-6f318ffc865b tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:28.110175 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.quota [None req-311f8df1-976c-4ded-8c46-6f318ffc865b tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Getting quotas for project 0ba0a418ceb742fdb01c98c5d58424a1. Resources: {'cores', 'instances', 'ram'} {{(pid=125871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 03:56:28.114146 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.quota [None req-311f8df1-976c-4ded-8c46-6f318ffc865b tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Getting quotas for user 87b22f27c7144a3d96f41747473fe646 and project 0ba0a418ceb742fdb01c98c5d58424a1. Resources: {'cores', 'instances', 'ram'} {{(pid=125871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 03:56:28.176563 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-311f8df1-976c-4ded-8c46-6f318ffc865b tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Going to run 1 instances... {{(pid=125871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 03:56:28.178688 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-311f8df1-976c-4ded-8c46-6f318ffc865b tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] [instance: d471c80c-12be-4e18-89d6-d64601602d39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='89a4b183-37fd-40e8-a136-a69c1a500455',volume_size=None,volume_type=None)] {{(pid=125871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 03:56:28.579196 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-311f8df1-976c-4ded-8c46-6f318ffc865b tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.228986 Oct 17 03:56:28.579988 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 198/394] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 17 03:56:27 2022] POST /compute/v2.1/servers => generated 404 bytes in 1230 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 03:56:28.593300 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-b215a8aa-664b-4b8c-b97c-e01b0f226140 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:28.594929 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-b215a8aa-664b-4b8c-b97c-e01b0f226140 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] [instance: d471c80c-12be-4e18-89d6-d64601602d39] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:28.610279 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-2e8c5f6f-9cb5-4e2f-8f50-0a36371cec7e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:28.611139 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-2e8c5f6f-9cb5-4e2f-8f50-0a36371cec7e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:28.618381 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2e8c5f6f-9cb5-4e2f-8f50-0a36371cec7e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:28.618381 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2e8c5f6f-9cb5-4e2f-8f50-0a36371cec7e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:28.618381 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2e8c5f6f-9cb5-4e2f-8f50-0a36371cec7e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:28.619035 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2e8c5f6f-9cb5-4e2f-8f50-0a36371cec7e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:28.619700 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2e8c5f6f-9cb5-4e2f-8f50-0a36371cec7e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:28.620361 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2e8c5f6f-9cb5-4e2f-8f50-0a36371cec7e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:28.678714 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-b215a8aa-664b-4b8c-b97c-e01b0f226140 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b22f27c7144a3d96f41747473fe646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0a418ceb742fdb01c98c5d58424a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:28.688961 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-b215a8aa-664b-4b8c-b97c-e01b0f226140 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] 10.222.0.16 "GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39" status: 200 len: 1088 microversion: 2.1 time: 0.101663 Oct 17 03:56:28.690687 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 197/395] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:28 2022] GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39 => generated 1088 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:56:28.789251 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-2e8c5f6f-9cb5-4e2f-8f50-0a36371cec7e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:28.798100 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-2e8c5f6f-9cb5-4e2f-8f50-0a36371cec7e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:28.799594 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-2e8c5f6f-9cb5-4e2f-8f50-0a36371cec7e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:28.800739 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-2e8c5f6f-9cb5-4e2f-8f50-0a36371cec7e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1723 microversion: 2.20 time: 0.195083 Oct 17 03:56:28.801411 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 199/396] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:56:28 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:56:29.029222 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-2f03cc7f-d51d-49e8-8fd1-3183f651c82d tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:29.030092 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-2f03cc7f-d51d-49e8-8fd1-3183f651c82d tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] [instance: 799ed606-0d4b-42b8-9faa-1d82271135d1] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:29.037438 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2f03cc7f-d51d-49e8-8fd1-3183f651c82d tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:29.037932 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2f03cc7f-d51d-49e8-8fd1-3183f651c82d tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:29.038520 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2f03cc7f-d51d-49e8-8fd1-3183f651c82d tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:29.039329 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2f03cc7f-d51d-49e8-8fd1-3183f651c82d tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:29.039787 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2f03cc7f-d51d-49e8-8fd1-3183f651c82d tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:29.040214 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2f03cc7f-d51d-49e8-8fd1-3183f651c82d tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:29.073226 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2f03cc7f-d51d-49e8-8fd1-3183f651c82d tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:29.073718 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2f03cc7f-d51d-49e8-8fd1-3183f651c82d tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:29.074706 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2f03cc7f-d51d-49e8-8fd1-3183f651c82d tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:29.075149 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.objects.instance [None req-2f03cc7f-d51d-49e8-8fd1-3183f651c82d tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lazy-loading 'fault' on Instance uuid 799ed606-0d4b-42b8-9faa-1d82271135d1 {{(pid=125872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:56:29.137990 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-2f03cc7f-d51d-49e8-8fd1-3183f651c82d tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a421a2a8899342b38aa61676f3b7bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7543f344fc54e41836865a828c4754d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:29.141704 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:56:29.146612 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-2f03cc7f-d51d-49e8-8fd1-3183f651c82d tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] 10.222.0.16 "GET /compute/v2.1/servers/799ed606-0d4b-42b8-9faa-1d82271135d1" status: 200 len: 1304 microversion: 2.1 time: 0.121810 Oct 17 03:56:29.147251 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 198/397] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:29 2022] GET /compute/v2.1/servers/799ed606-0d4b-42b8-9faa-1d82271135d1 => generated 1304 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:56:29.712578 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-6aace6f0-95da-437e-a264-2c02a3f2b307 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:29.713212 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-6aace6f0-95da-437e-a264-2c02a3f2b307 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] [instance: d471c80c-12be-4e18-89d6-d64601602d39] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:29.719213 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-6aace6f0-95da-437e-a264-2c02a3f2b307 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:29.719692 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-6aace6f0-95da-437e-a264-2c02a3f2b307 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:29.720123 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-6aace6f0-95da-437e-a264-2c02a3f2b307 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:29.720810 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-6aace6f0-95da-437e-a264-2c02a3f2b307 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:29.721347 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-6aace6f0-95da-437e-a264-2c02a3f2b307 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:29.721757 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-6aace6f0-95da-437e-a264-2c02a3f2b307 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:29.788546 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-6aace6f0-95da-437e-a264-2c02a3f2b307 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b22f27c7144a3d96f41747473fe646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0a418ceb742fdb01c98c5d58424a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:29.798956 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-6aace6f0-95da-437e-a264-2c02a3f2b307 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] 10.222.0.16 "GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39" status: 200 len: 1138 microversion: 2.1 time: 0.088306 Oct 17 03:56:29.798956 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 200/398] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:29 2022] GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39 => generated 1138 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:56:29.826581 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-64bf7c45-28e4-4c0d-8159-f3cca782a7a3 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:29.827256 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-64bf7c45-28e4-4c0d-8159-f3cca782a7a3 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:29.833995 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-64bf7c45-28e4-4c0d-8159-f3cca782a7a3 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:29.834480 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-64bf7c45-28e4-4c0d-8159-f3cca782a7a3 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:29.834916 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-64bf7c45-28e4-4c0d-8159-f3cca782a7a3 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:29.835645 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-64bf7c45-28e4-4c0d-8159-f3cca782a7a3 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:29.836134 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-64bf7c45-28e4-4c0d-8159-f3cca782a7a3 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:29.836547 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-64bf7c45-28e4-4c0d-8159-f3cca782a7a3 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:29.968720 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-64bf7c45-28e4-4c0d-8159-f3cca782a7a3 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:29.977074 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-64bf7c45-28e4-4c0d-8159-f3cca782a7a3 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:29.978524 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-64bf7c45-28e4-4c0d-8159-f3cca782a7a3 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:29.979735 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-64bf7c45-28e4-4c0d-8159-f3cca782a7a3 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1723 microversion: 2.20 time: 0.157186 Oct 17 03:56:29.980835 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 199/399] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:56:29 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:56:30.171986 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-a6725262-d5e4-4182-9cb2-5a82f0d3a795 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:30.172516 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-a6725262-d5e4-4182-9cb2-5a82f0d3a795 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] [instance: 799ed606-0d4b-42b8-9faa-1d82271135d1] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:30.179264 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a6725262-d5e4-4182-9cb2-5a82f0d3a795 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:30.179783 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a6725262-d5e4-4182-9cb2-5a82f0d3a795 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:30.180217 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a6725262-d5e4-4182-9cb2-5a82f0d3a795 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:30.180910 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a6725262-d5e4-4182-9cb2-5a82f0d3a795 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:30.181450 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a6725262-d5e4-4182-9cb2-5a82f0d3a795 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:30.181880 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a6725262-d5e4-4182-9cb2-5a82f0d3a795 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:30.196605 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.wsgi [None req-a6725262-d5e4-4182-9cb2-5a82f0d3a795 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] HTTP exception thrown: Instance 799ed606-0d4b-42b8-9faa-1d82271135d1 could not be found. Oct 17 03:56:30.198262 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-a6725262-d5e4-4182-9cb2-5a82f0d3a795 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Request method failure captured: Oct 17 03:56:30.198262 dv-cinder-815582-16-smb devstack@n-api.service[125871]: request: GET /compute/v2.1/servers/799ed606-0d4b-42b8-9faa-1d82271135d1 HTTP/1.1 Oct 17 03:56:30.198262 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Accept: application/json Oct 17 03:56:30.198262 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Accept-Encoding: identity Oct 17 03:56:30.198262 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Connection: close Oct 17 03:56:30.198262 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Content-Length: 0 Oct 17 03:56:30.198262 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Content-Type: application/json Oct 17 03:56:30.198262 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Host: 10.222.0.16 Oct 17 03:56:30.198262 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Openstack-System-Scope: None Oct 17 03:56:30.198262 dv-cinder-815582-16-smb devstack@n-api.service[125871]: User-Agent: python-urllib3/1.26.12 Oct 17 03:56:30.198262 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Auth-Token: gAAAAABjTNJTWkXo3aMqRBdA_Wz8GxFT38oJ36pL7cIqVg8rl0ZDefIlNzHYhK4rSkV2dAum6tCAluOwkYOJ2bQGUaEusM-bhBdlduqq83N08_CCFciIZ9dEGej8EO-UmZVvb-0MFCLIT2mO6DrniQVN7KAMdKMJy7HyH-caQ9X3TrRgD1f2QjE Oct 17 03:56:30.198262 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Domain-Id: None Oct 17 03:56:30.198262 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Domain-Name: None Oct 17 03:56:30.198262 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Identity-Status: Confirmed Oct 17 03:56:30.198262 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Is-Admin-Project: True Oct 17 03:56:30.198262 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Domain-Id: default Oct 17 03:56:30.198262 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Domain-Name: Default Oct 17 03:56:30.198262 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Id: b7543f344fc54e41836865a828c4754d Oct 17 03:56:30.198262 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Name: tempest-VolumesActionsTest-135237744 Oct 17 03:56:30.198262 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Role: reader,member Oct 17 03:56:30.198262 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Roles: reader,member Oct 17 03:56:30.199835 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b7543f344fc54e41836865a828c4754d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b7543f344fc54e41836865a828c4754d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b7543f344fc54e41836865a828c4754d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b7543f344fc54e41836865a828c4754d", "adminURL": "http://10.222.0.16:8080"}]}] Oct 17 03:56:30.199835 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant: tempest-VolumesActionsTest-135237744 Oct 17 03:56:30.199835 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant-Id: b7543f344fc54e41836865a828c4754d Oct 17 03:56:30.199835 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant-Name: tempest-VolumesActionsTest-135237744 Oct 17 03:56:30.199835 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User: tempest-VolumesActionsTest-135237744-project Oct 17 03:56:30.199835 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Domain-Id: default Oct 17 03:56:30.199835 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Domain-Name: Default Oct 17 03:56:30.199835 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Id: a421a2a8899342b38aa61676f3b7bc01 Oct 17 03:56:30.199835 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Name: tempest-VolumesActionsTest-135237744-project Oct 17 03:56:30.199835 dv-cinder-815582-16-smb devstack@n-api.service[125871]: method: > Oct 17 03:56:30.199835 dv-cinder-815582-16-smb devstack@n-api.service[125871]: exception: Instance 799ed606-0d4b-42b8-9faa-1d82271135d1 could not be found. Oct 17 03:56:30.199835 dv-cinder-815582-16-smb devstack@n-api.service[125871]: action_args: {'id': '799ed606-0d4b-42b8-9faa-1d82271135d1'} Oct 17 03:56:30.201451 dv-cinder-815582-16-smb devstack@n-api.service[125871]: {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:56:30.201451 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:56:30.201451 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 03:56:30.201451 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 03:56:30.201451 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 03:56:30.201451 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 03:56:30.201451 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 03:56:30.201451 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 03:56:30.201451 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 03:56:30.201451 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 03:56:30.201451 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 799ed606-0d4b-42b8-9faa-1d82271135d1 could not be found. Oct 17 03:56:30.201451 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:56:30.201451 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:56:30.201451 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:56:30.201451 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:56:30.201451 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:56:30.201451 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:56:30.201451 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:56:30.201451 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:56:30.201451 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:56:30.202676 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:56:30.202676 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 03:56:30.202676 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 03:56:30.202676 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 03:56:30.202676 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 03:56:30.202676 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 03:56:30.202676 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:56:30.202676 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 799ed606-0d4b-42b8-9faa-1d82271135d1 could not be found. Oct 17 03:56:30.202676 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:56:30.202676 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:56:30.202676 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:56:30.202676 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:56:30.202676 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:56:30.202676 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:56:30.202676 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:56:30.202676 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:56:30.202676 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 799ed606-0d4b-42b8-9faa-1d82271135d1 could not be found. Oct 17 03:56:30.202676 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:56:30.204260 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-a6725262-d5e4-4182-9cb2-5a82f0d3a795 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Returning 404 to user: Instance 799ed606-0d4b-42b8-9faa-1d82271135d1 could not be found. {{(pid=125871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:56:30.204260 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-a6725262-d5e4-4182-9cb2-5a82f0d3a795 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] 10.222.0.16 "GET /compute/v2.1/servers/799ed606-0d4b-42b8-9faa-1d82271135d1" status: 404 len: 111 microversion: 2.1 time: 0.032449 Oct 17 03:56:30.204260 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 201/400] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:30 2022] GET /compute/v2.1/servers/799ed606-0d4b-42b8-9faa-1d82271135d1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 03:56:30.305443 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-83e03b09-70d3-4f2e-b396-fc8a88f7037b tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-35858792", "imageRef": "add1979e-0a3b-4403-a8ae-8d9a7b045fc2", "flavorRef": "452", "networks": [{"uuid": "3657b653-4efe-4ce1-bcc3-dc702e2e292e"}]}} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:56:30.360225 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.network.neutron [None req-83e03b09-70d3-4f2e-b396-fc8a88f7037b tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] validate_networks() for [('3657b653-4efe-4ce1-bcc3-dc702e2e292e', None, None, None, None, None)] {{(pid=125872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 03:56:30.711901 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.virt.hardware [None req-83e03b09-70d3-4f2e-b396-fc8a88f7037b tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Flavor limits 0:0:0 {{(pid=125872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 03:56:30.712319 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.virt.hardware [None req-83e03b09-70d3-4f2e-b396-fc8a88f7037b tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Image limits 0:0:0 {{(pid=125872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 03:56:30.712944 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.virt.hardware [None req-83e03b09-70d3-4f2e-b396-fc8a88f7037b tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Flavor pref 0:0:0 {{(pid=125872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 03:56:30.713349 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.virt.hardware [None req-83e03b09-70d3-4f2e-b396-fc8a88f7037b tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Image pref 0:0:0 {{(pid=125872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 03:56:30.713896 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.virt.hardware [None req-83e03b09-70d3-4f2e-b396-fc8a88f7037b tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 03:56:30.724141 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-83e03b09-70d3-4f2e-b396-fc8a88f7037b tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:30.724614 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-83e03b09-70d3-4f2e-b396-fc8a88f7037b tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:30.725043 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-83e03b09-70d3-4f2e-b396-fc8a88f7037b tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:30.725759 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-83e03b09-70d3-4f2e-b396-fc8a88f7037b tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:30.726204 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-83e03b09-70d3-4f2e-b396-fc8a88f7037b tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:30.726618 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-83e03b09-70d3-4f2e-b396-fc8a88f7037b tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:30.743615 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.quota [None req-83e03b09-70d3-4f2e-b396-fc8a88f7037b tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Getting quotas for project b7543f344fc54e41836865a828c4754d. Resources: {'cores', 'instances', 'ram'} {{(pid=125872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 03:56:30.747571 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.quota [None req-83e03b09-70d3-4f2e-b396-fc8a88f7037b tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Getting quotas for user a421a2a8899342b38aa61676f3b7bc01 and project b7543f344fc54e41836865a828c4754d. Resources: {'cores', 'instances', 'ram'} {{(pid=125872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 03:56:30.758432 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-83e03b09-70d3-4f2e-b396-fc8a88f7037b tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Going to run 1 instances... {{(pid=125872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 03:56:30.761829 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-83e03b09-70d3-4f2e-b396-fc8a88f7037b tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] [instance: 35e9dd79-985d-4adf-b151-55b1db06469c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='add1979e-0a3b-4403-a8ae-8d9a7b045fc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 03:56:30.781710 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:56:30.820446 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-5b10245f-b0e3-4036-9dba-bc38055838d9 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:30.821245 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-5b10245f-b0e3-4036-9dba-bc38055838d9 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] [instance: d471c80c-12be-4e18-89d6-d64601602d39] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:30.829719 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5b10245f-b0e3-4036-9dba-bc38055838d9 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:30.830199 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5b10245f-b0e3-4036-9dba-bc38055838d9 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:30.830631 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5b10245f-b0e3-4036-9dba-bc38055838d9 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:30.831430 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5b10245f-b0e3-4036-9dba-bc38055838d9 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:30.831880 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5b10245f-b0e3-4036-9dba-bc38055838d9 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:30.832296 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5b10245f-b0e3-4036-9dba-bc38055838d9 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:30.891470 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-83e03b09-70d3-4f2e-b396-fc8a88f7037b tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.589740 Oct 17 03:56:30.892241 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 200/401] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 17 03:56:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 03:56:30.895742 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-5b10245f-b0e3-4036-9dba-bc38055838d9 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b22f27c7144a3d96f41747473fe646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0a418ceb742fdb01c98c5d58424a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:30.903518 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-e25cf617-23c4-4b80-85d7-9683ea165f39 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:30.903880 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-5b10245f-b0e3-4036-9dba-bc38055838d9 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] 10.222.0.16 "GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39" status: 200 len: 1186 microversion: 2.1 time: 0.087170 Oct 17 03:56:30.904126 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-e25cf617-23c4-4b80-85d7-9683ea165f39 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] [instance: 35e9dd79-985d-4adf-b151-55b1db06469c] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:30.904589 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 202/402] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:30 2022] GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39 => generated 1186 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:56:30.961407 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-e25cf617-23c4-4b80-85d7-9683ea165f39 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a421a2a8899342b38aa61676f3b7bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7543f344fc54e41836865a828c4754d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:30.969526 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-e25cf617-23c4-4b80-85d7-9683ea165f39 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] 10.222.0.16 "GET /compute/v2.1/servers/35e9dd79-985d-4adf-b151-55b1db06469c" status: 200 len: 1212 microversion: 2.1 time: 0.069872 Oct 17 03:56:30.970089 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 201/403] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:30 2022] GET /compute/v2.1/servers/35e9dd79-985d-4adf-b151-55b1db06469c => generated 1212 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:56:31.007433 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-76109ccb-20ea-422c-9d32-fec3e8ae6821 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:31.008168 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-76109ccb-20ea-422c-9d32-fec3e8ae6821 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:31.017520 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-76109ccb-20ea-422c-9d32-fec3e8ae6821 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:31.018217 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-76109ccb-20ea-422c-9d32-fec3e8ae6821 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:31.018753 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-76109ccb-20ea-422c-9d32-fec3e8ae6821 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:31.019590 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-76109ccb-20ea-422c-9d32-fec3e8ae6821 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:31.020219 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-76109ccb-20ea-422c-9d32-fec3e8ae6821 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:31.020653 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-76109ccb-20ea-422c-9d32-fec3e8ae6821 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:31.258039 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-76109ccb-20ea-422c-9d32-fec3e8ae6821 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:31.269942 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-76109ccb-20ea-422c-9d32-fec3e8ae6821 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:31.274486 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-76109ccb-20ea-422c-9d32-fec3e8ae6821 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:31.275885 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-76109ccb-20ea-422c-9d32-fec3e8ae6821 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1723 microversion: 2.20 time: 0.272840 Oct 17 03:56:31.280053 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 203/404] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:56:31 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1723 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:56:31.929068 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-9b25c001-900b-42d3-b841-9e23cf271734 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:31.929724 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-9b25c001-900b-42d3-b841-9e23cf271734 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] [instance: d471c80c-12be-4e18-89d6-d64601602d39] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:31.937399 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-9b25c001-900b-42d3-b841-9e23cf271734 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:31.937872 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-9b25c001-900b-42d3-b841-9e23cf271734 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:31.938416 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-9b25c001-900b-42d3-b841-9e23cf271734 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:31.939214 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-9b25c001-900b-42d3-b841-9e23cf271734 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:31.939680 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-9b25c001-900b-42d3-b841-9e23cf271734 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:31.940260 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-9b25c001-900b-42d3-b841-9e23cf271734 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:31.995324 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-afdf4d17-9996-49f8-8a25-373c61293147 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:31.996504 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-afdf4d17-9996-49f8-8a25-373c61293147 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] [instance: 35e9dd79-985d-4adf-b151-55b1db06469c] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:32.002717 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-9b25c001-900b-42d3-b841-9e23cf271734 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b22f27c7144a3d96f41747473fe646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0a418ceb742fdb01c98c5d58424a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:32.002922 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-afdf4d17-9996-49f8-8a25-373c61293147 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:32.003472 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-afdf4d17-9996-49f8-8a25-373c61293147 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:32.003913 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-afdf4d17-9996-49f8-8a25-373c61293147 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:32.004664 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-afdf4d17-9996-49f8-8a25-373c61293147 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:32.005124 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-afdf4d17-9996-49f8-8a25-373c61293147 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:32.005549 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-afdf4d17-9996-49f8-8a25-373c61293147 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:32.011059 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-9b25c001-900b-42d3-b841-9e23cf271734 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] 10.222.0.16 "GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39" status: 200 len: 1204 microversion: 2.1 time: 0.086286 Oct 17 03:56:32.011678 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 202/405] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:31 2022] GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39 => generated 1204 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:56:32.068252 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-afdf4d17-9996-49f8-8a25-373c61293147 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a421a2a8899342b38aa61676f3b7bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7543f344fc54e41836865a828c4754d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:32.075911 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-afdf4d17-9996-49f8-8a25-373c61293147 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] 10.222.0.16 "GET /compute/v2.1/servers/35e9dd79-985d-4adf-b151-55b1db06469c" status: 200 len: 1216 microversion: 2.1 time: 0.084658 Oct 17 03:56:32.076473 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 204/406] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:31 2022] GET /compute/v2.1/servers/35e9dd79-985d-4adf-b151-55b1db06469c => generated 1216 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:56:32.310349 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-e717d05c-15cb-4dfa-b4a7-a39451af6764 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:32.313310 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-e717d05c-15cb-4dfa-b4a7-a39451af6764 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:32.320706 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e717d05c-15cb-4dfa-b4a7-a39451af6764 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:32.321196 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e717d05c-15cb-4dfa-b4a7-a39451af6764 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:32.321966 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e717d05c-15cb-4dfa-b4a7-a39451af6764 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:32.322342 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e717d05c-15cb-4dfa-b4a7-a39451af6764 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:32.322843 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e717d05c-15cb-4dfa-b4a7-a39451af6764 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:32.323233 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e717d05c-15cb-4dfa-b4a7-a39451af6764 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:32.471356 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-e717d05c-15cb-4dfa-b4a7-a39451af6764 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:32.481165 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-e717d05c-15cb-4dfa-b4a7-a39451af6764 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:32.483406 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-e717d05c-15cb-4dfa-b4a7-a39451af6764 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:32.484759 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-e717d05c-15cb-4dfa-b4a7-a39451af6764 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1723 microversion: 2.20 time: 0.180317 Oct 17 03:56:32.485322 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 203/407] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:56:32 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:56:33.034843 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-89fd14ae-72a9-4ec9-bea0-c623d79fa5c1 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:33.035571 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-89fd14ae-72a9-4ec9-bea0-c623d79fa5c1 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] [instance: d471c80c-12be-4e18-89d6-d64601602d39] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:33.046117 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-89fd14ae-72a9-4ec9-bea0-c623d79fa5c1 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:33.046117 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-89fd14ae-72a9-4ec9-bea0-c623d79fa5c1 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:33.046117 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-89fd14ae-72a9-4ec9-bea0-c623d79fa5c1 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:33.046117 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-89fd14ae-72a9-4ec9-bea0-c623d79fa5c1 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:33.047015 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-89fd14ae-72a9-4ec9-bea0-c623d79fa5c1 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:33.047653 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-89fd14ae-72a9-4ec9-bea0-c623d79fa5c1 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:33.099633 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-1ee404e0-77d9-4d9c-bcf1-d70a3d3a4721 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:33.100314 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-1ee404e0-77d9-4d9c-bcf1-d70a3d3a4721 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] [instance: 35e9dd79-985d-4adf-b151-55b1db06469c] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:33.107618 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1ee404e0-77d9-4d9c-bcf1-d70a3d3a4721 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:33.108107 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1ee404e0-77d9-4d9c-bcf1-d70a3d3a4721 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:33.108914 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1ee404e0-77d9-4d9c-bcf1-d70a3d3a4721 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:33.109672 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1ee404e0-77d9-4d9c-bcf1-d70a3d3a4721 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:33.110166 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1ee404e0-77d9-4d9c-bcf1-d70a3d3a4721 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:33.110598 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1ee404e0-77d9-4d9c-bcf1-d70a3d3a4721 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:33.179529 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-1ee404e0-77d9-4d9c-bcf1-d70a3d3a4721 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a421a2a8899342b38aa61676f3b7bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7543f344fc54e41836865a828c4754d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:33.190674 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-1ee404e0-77d9-4d9c-bcf1-d70a3d3a4721 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] 10.222.0.16 "GET /compute/v2.1/servers/35e9dd79-985d-4adf-b151-55b1db06469c" status: 200 len: 1264 microversion: 2.1 time: 0.094971 Oct 17 03:56:33.191460 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 204/408] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:33 2022] GET /compute/v2.1/servers/35e9dd79-985d-4adf-b151-55b1db06469c => generated 1264 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:56:33.510932 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-f8f941af-b535-4c21-be36-e39b8e18c590 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:33.511576 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-f8f941af-b535-4c21-be36-e39b8e18c590 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:33.517514 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f8f941af-b535-4c21-be36-e39b8e18c590 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:33.518003 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f8f941af-b535-4c21-be36-e39b8e18c590 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:33.518444 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f8f941af-b535-4c21-be36-e39b8e18c590 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:33.519144 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f8f941af-b535-4c21-be36-e39b8e18c590 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:33.519627 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f8f941af-b535-4c21-be36-e39b8e18c590 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:33.520053 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f8f941af-b535-4c21-be36-e39b8e18c590 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:33.523325 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-89fd14ae-72a9-4ec9-bea0-c623d79fa5c1 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b22f27c7144a3d96f41747473fe646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0a418ceb742fdb01c98c5d58424a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:33.531098 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-89fd14ae-72a9-4ec9-bea0-c623d79fa5c1 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] 10.222.0.16 "GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39" status: 200 len: 1258 microversion: 2.1 time: 0.500267 Oct 17 03:56:33.531699 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 205/409] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:33 2022] GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39 => generated 1258 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:56:33.628502 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [req-c827852f-fd5c-45b1-afc1-2b87b9004717 req-9101140e-b9b1-4826-8d25-5e45a8b95143 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d471c80c-12be-4e18-89d6-d64601602d39", "tag": "63565771-2da1-4fe4-a238-2f393636b21d"}]} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:56:33.639219 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-c827852f-fd5c-45b1-afc1-2b87b9004717 req-9101140e-b9b1-4826-8d25-5e45a8b95143 service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:33.642660 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-c827852f-fd5c-45b1-afc1-2b87b9004717 req-9101140e-b9b1-4826-8d25-5e45a8b95143 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:33.642660 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-c827852f-fd5c-45b1-afc1-2b87b9004717 req-9101140e-b9b1-4826-8d25-5e45a8b95143 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:33.651656 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.compute.server_external_events [req-c827852f-fd5c-45b1-afc1-2b87b9004717 req-9101140e-b9b1-4826-8d25-5e45a8b95143 service nova] Creating event network-changed:63565771-2da1-4fe4-a238-2f393636b21d for instance d471c80c-12be-4e18-89d6-d64601602d39 on hv-cinder-81558 Oct 17 03:56:33.656830 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-f8f941af-b535-4c21-be36-e39b8e18c590 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:33.661778 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [req-c827852f-fd5c-45b1-afc1-2b87b9004717 req-9101140e-b9b1-4826-8d25-5e45a8b95143 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036243 Oct 17 03:56:33.666853 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 206/410] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 03:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:56:33.667980 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-f8f941af-b535-4c21-be36-e39b8e18c590 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:33.669694 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-f8f941af-b535-4c21-be36-e39b8e18c590 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:33.671160 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-f8f941af-b535-4c21-be36-e39b8e18c590 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1723 microversion: 2.20 time: 0.164941 Oct 17 03:56:33.671777 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 205/411] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:56:33 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:56:34.216113 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-5558ab0e-f232-4a90-b06c-49a03604bf08 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:34.216943 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-5558ab0e-f232-4a90-b06c-49a03604bf08 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] [instance: 35e9dd79-985d-4adf-b151-55b1db06469c] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:34.223454 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5558ab0e-f232-4a90-b06c-49a03604bf08 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:34.224038 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5558ab0e-f232-4a90-b06c-49a03604bf08 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:34.224566 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5558ab0e-f232-4a90-b06c-49a03604bf08 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:34.225386 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5558ab0e-f232-4a90-b06c-49a03604bf08 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:34.226071 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5558ab0e-f232-4a90-b06c-49a03604bf08 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:34.226567 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5558ab0e-f232-4a90-b06c-49a03604bf08 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:34.344500 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-5558ab0e-f232-4a90-b06c-49a03604bf08 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a421a2a8899342b38aa61676f3b7bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7543f344fc54e41836865a828c4754d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:34.352412 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-5558ab0e-f232-4a90-b06c-49a03604bf08 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] 10.222.0.16 "GET /compute/v2.1/servers/35e9dd79-985d-4adf-b151-55b1db06469c" status: 200 len: 1282 microversion: 2.1 time: 0.141775 Oct 17 03:56:34.353243 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 207/412] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:34 2022] GET /compute/v2.1/servers/35e9dd79-985d-4adf-b151-55b1db06469c => generated 1282 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:56:34.555511 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-6fcf15da-cfe1-40aa-b7bc-d33f481ec9a5 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:34.556398 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-6fcf15da-cfe1-40aa-b7bc-d33f481ec9a5 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] [instance: d471c80c-12be-4e18-89d6-d64601602d39] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:34.564322 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6fcf15da-cfe1-40aa-b7bc-d33f481ec9a5 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:34.564883 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6fcf15da-cfe1-40aa-b7bc-d33f481ec9a5 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:34.565316 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6fcf15da-cfe1-40aa-b7bc-d33f481ec9a5 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:34.566248 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6fcf15da-cfe1-40aa-b7bc-d33f481ec9a5 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:34.566858 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6fcf15da-cfe1-40aa-b7bc-d33f481ec9a5 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:34.567991 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6fcf15da-cfe1-40aa-b7bc-d33f481ec9a5 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:34.706703 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-fe6ce723-58e7-4f62-9213-d1b3cf88d9c1 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:34.708205 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-fe6ce723-58e7-4f62-9213-d1b3cf88d9c1 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:34.719755 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-fe6ce723-58e7-4f62-9213-d1b3cf88d9c1 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:34.720631 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-fe6ce723-58e7-4f62-9213-d1b3cf88d9c1 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:34.721281 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-fe6ce723-58e7-4f62-9213-d1b3cf88d9c1 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:34.722822 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-fe6ce723-58e7-4f62-9213-d1b3cf88d9c1 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:34.723571 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-fe6ce723-58e7-4f62-9213-d1b3cf88d9c1 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:34.724004 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-6fcf15da-cfe1-40aa-b7bc-d33f481ec9a5 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b22f27c7144a3d96f41747473fe646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0a418ceb742fdb01c98c5d58424a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:34.724883 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-fe6ce723-58e7-4f62-9213-d1b3cf88d9c1 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:34.734221 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-6fcf15da-cfe1-40aa-b7bc-d33f481ec9a5 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] 10.222.0.16 "GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39" status: 200 len: 1258 microversion: 2.1 time: 0.182037 Oct 17 03:56:34.744074 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 206/413] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:34 2022] GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39 => generated 1258 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:56:35.050308 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-fe6ce723-58e7-4f62-9213-d1b3cf88d9c1 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:35.059111 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-fe6ce723-58e7-4f62-9213-d1b3cf88d9c1 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:35.060672 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-fe6ce723-58e7-4f62-9213-d1b3cf88d9c1 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:35.061908 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-fe6ce723-58e7-4f62-9213-d1b3cf88d9c1 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1723 microversion: 2.20 time: 0.364889 Oct 17 03:56:35.062549 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 208/414] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:56:34 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1723 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:56:35.376234 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-09504579-ed38-49dc-b10d-787719c85117 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:35.376842 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-09504579-ed38-49dc-b10d-787719c85117 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] [instance: 35e9dd79-985d-4adf-b151-55b1db06469c] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:35.382821 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-09504579-ed38-49dc-b10d-787719c85117 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:35.383396 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-09504579-ed38-49dc-b10d-787719c85117 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:35.383827 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-09504579-ed38-49dc-b10d-787719c85117 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:35.384509 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-09504579-ed38-49dc-b10d-787719c85117 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:35.385223 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-09504579-ed38-49dc-b10d-787719c85117 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:35.385641 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-09504579-ed38-49dc-b10d-787719c85117 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:35.517703 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-09504579-ed38-49dc-b10d-787719c85117 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a421a2a8899342b38aa61676f3b7bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7543f344fc54e41836865a828c4754d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:35.525387 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-09504579-ed38-49dc-b10d-787719c85117 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] 10.222.0.16 "GET /compute/v2.1/servers/35e9dd79-985d-4adf-b151-55b1db06469c" status: 200 len: 1312 microversion: 2.1 time: 0.153377 Oct 17 03:56:35.525950 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 207/415] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:35 2022] GET /compute/v2.1/servers/35e9dd79-985d-4adf-b151-55b1db06469c => generated 1312 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:56:35.759501 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-c98e8caa-e5e1-457a-afc2-4ba5dcbf5533 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:35.760772 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-c98e8caa-e5e1-457a-afc2-4ba5dcbf5533 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] [instance: d471c80c-12be-4e18-89d6-d64601602d39] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:35.767283 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c98e8caa-e5e1-457a-afc2-4ba5dcbf5533 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:35.767772 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c98e8caa-e5e1-457a-afc2-4ba5dcbf5533 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:35.768218 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c98e8caa-e5e1-457a-afc2-4ba5dcbf5533 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:35.768915 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c98e8caa-e5e1-457a-afc2-4ba5dcbf5533 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:35.769375 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c98e8caa-e5e1-457a-afc2-4ba5dcbf5533 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:35.769803 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c98e8caa-e5e1-457a-afc2-4ba5dcbf5533 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:35.904225 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-c98e8caa-e5e1-457a-afc2-4ba5dcbf5533 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b22f27c7144a3d96f41747473fe646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0a418ceb742fdb01c98c5d58424a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:35.912579 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-c98e8caa-e5e1-457a-afc2-4ba5dcbf5533 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] 10.222.0.16 "GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39" status: 200 len: 1258 microversion: 2.1 time: 0.156587 Oct 17 03:56:35.913420 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 209/416] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:35 2022] GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39 => generated 1258 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:56:36.088720 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-265a7b64-0161-4bdb-afda-cc92af635371 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:36.089404 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-265a7b64-0161-4bdb-afda-cc92af635371 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:36.096648 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-265a7b64-0161-4bdb-afda-cc92af635371 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:36.097133 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-265a7b64-0161-4bdb-afda-cc92af635371 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:36.097563 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-265a7b64-0161-4bdb-afda-cc92af635371 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:36.098266 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-265a7b64-0161-4bdb-afda-cc92af635371 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:36.098727 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-265a7b64-0161-4bdb-afda-cc92af635371 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:36.099133 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-265a7b64-0161-4bdb-afda-cc92af635371 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:36.227327 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-265a7b64-0161-4bdb-afda-cc92af635371 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:36.235425 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-265a7b64-0161-4bdb-afda-cc92af635371 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:36.236861 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-265a7b64-0161-4bdb-afda-cc92af635371 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:36.238011 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-265a7b64-0161-4bdb-afda-cc92af635371 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1723 microversion: 2.20 time: 0.154637 Oct 17 03:56:36.238565 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 208/417] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:56:36 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:56:36.553925 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-bbc183d6-7052-42ba-b8b9-c689adfeff24 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:36.554547 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-bbc183d6-7052-42ba-b8b9-c689adfeff24 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] [instance: 35e9dd79-985d-4adf-b151-55b1db06469c] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:36.561498 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-bbc183d6-7052-42ba-b8b9-c689adfeff24 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:36.561991 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-bbc183d6-7052-42ba-b8b9-c689adfeff24 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:36.562444 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-bbc183d6-7052-42ba-b8b9-c689adfeff24 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:36.563131 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-bbc183d6-7052-42ba-b8b9-c689adfeff24 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:36.563614 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-bbc183d6-7052-42ba-b8b9-c689adfeff24 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:36.564042 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-bbc183d6-7052-42ba-b8b9-c689adfeff24 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:36.782826 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-bbc183d6-7052-42ba-b8b9-c689adfeff24 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a421a2a8899342b38aa61676f3b7bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7543f344fc54e41836865a828c4754d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:36.790706 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-bbc183d6-7052-42ba-b8b9-c689adfeff24 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] 10.222.0.16 "GET /compute/v2.1/servers/35e9dd79-985d-4adf-b151-55b1db06469c" status: 200 len: 1312 microversion: 2.1 time: 0.240735 Oct 17 03:56:36.791362 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 210/418] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:36 2022] GET /compute/v2.1/servers/35e9dd79-985d-4adf-b151-55b1db06469c => generated 1312 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:56:36.933930 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-009fc0bd-62bd-400f-88f5-e78fde93ddd5 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:36.934496 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-009fc0bd-62bd-400f-88f5-e78fde93ddd5 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] [instance: d471c80c-12be-4e18-89d6-d64601602d39] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:36.940556 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-009fc0bd-62bd-400f-88f5-e78fde93ddd5 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:36.941038 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-009fc0bd-62bd-400f-88f5-e78fde93ddd5 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:36.941475 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-009fc0bd-62bd-400f-88f5-e78fde93ddd5 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:36.942179 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-009fc0bd-62bd-400f-88f5-e78fde93ddd5 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:36.942636 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-009fc0bd-62bd-400f-88f5-e78fde93ddd5 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:36.943060 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-009fc0bd-62bd-400f-88f5-e78fde93ddd5 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:37.080369 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-009fc0bd-62bd-400f-88f5-e78fde93ddd5 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b22f27c7144a3d96f41747473fe646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0a418ceb742fdb01c98c5d58424a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:37.090467 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-009fc0bd-62bd-400f-88f5-e78fde93ddd5 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] 10.222.0.16 "GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39" status: 200 len: 1258 microversion: 2.1 time: 0.160223 Oct 17 03:56:37.091142 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 209/419] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:36 2022] GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39 => generated 1258 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:56:37.264385 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-03775ee8-de6a-4845-9304-a5a9b7ce61e6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:37.265029 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-03775ee8-de6a-4845-9304-a5a9b7ce61e6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:37.273324 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-03775ee8-de6a-4845-9304-a5a9b7ce61e6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:37.273821 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-03775ee8-de6a-4845-9304-a5a9b7ce61e6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:37.274433 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-03775ee8-de6a-4845-9304-a5a9b7ce61e6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:37.275366 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-03775ee8-de6a-4845-9304-a5a9b7ce61e6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:37.276019 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-03775ee8-de6a-4845-9304-a5a9b7ce61e6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:37.276459 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-03775ee8-de6a-4845-9304-a5a9b7ce61e6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:37.481081 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-03775ee8-de6a-4845-9304-a5a9b7ce61e6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:37.489231 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-03775ee8-de6a-4845-9304-a5a9b7ce61e6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:37.491340 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-03775ee8-de6a-4845-9304-a5a9b7ce61e6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:37.492577 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-03775ee8-de6a-4845-9304-a5a9b7ce61e6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1723 microversion: 2.20 time: 0.233075 Oct 17 03:56:37.493138 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 211/420] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:56:37 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1723 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:56:37.602249 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [req-8e4846eb-a287-4276-9129-b3b6810c96cf req-b4b50f35-92d5-4876-8149-bd9877f745c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35e9dd79-985d-4adf-b151-55b1db06469c", "tag": "e266ae12-156a-4125-94a2-8d0f5d5d867e"}]} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:56:37.614014 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-8e4846eb-a287-4276-9129-b3b6810c96cf req-b4b50f35-92d5-4876-8149-bd9877f745c2 service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:37.614492 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-8e4846eb-a287-4276-9129-b3b6810c96cf req-b4b50f35-92d5-4876-8149-bd9877f745c2 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:37.614946 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-8e4846eb-a287-4276-9129-b3b6810c96cf req-b4b50f35-92d5-4876-8149-bd9877f745c2 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:37.627000 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.compute.server_external_events [req-8e4846eb-a287-4276-9129-b3b6810c96cf req-b4b50f35-92d5-4876-8149-bd9877f745c2 service nova] Creating event network-changed:e266ae12-156a-4125-94a2-8d0f5d5d867e for instance 35e9dd79-985d-4adf-b151-55b1db06469c on hv-cinder-81558 Oct 17 03:56:37.632004 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [req-8e4846eb-a287-4276-9129-b3b6810c96cf req-b4b50f35-92d5-4876-8149-bd9877f745c2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033831 Oct 17 03:56:37.632607 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 210/421] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 03:56:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:56:37.815012 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-6d83671a-701c-4388-ba2e-7c6e904a1969 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:37.815792 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-6d83671a-701c-4388-ba2e-7c6e904a1969 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] [instance: 35e9dd79-985d-4adf-b151-55b1db06469c] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:37.821791 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-6d83671a-701c-4388-ba2e-7c6e904a1969 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:37.822362 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-6d83671a-701c-4388-ba2e-7c6e904a1969 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:37.822858 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-6d83671a-701c-4388-ba2e-7c6e904a1969 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:37.823633 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-6d83671a-701c-4388-ba2e-7c6e904a1969 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:37.824614 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-6d83671a-701c-4388-ba2e-7c6e904a1969 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:37.825045 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-6d83671a-701c-4388-ba2e-7c6e904a1969 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:38.030004 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-6d83671a-701c-4388-ba2e-7c6e904a1969 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a421a2a8899342b38aa61676f3b7bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7543f344fc54e41836865a828c4754d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:38.037725 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-6d83671a-701c-4388-ba2e-7c6e904a1969 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] 10.222.0.16 "GET /compute/v2.1/servers/35e9dd79-985d-4adf-b151-55b1db06469c" status: 200 len: 1312 microversion: 2.1 time: 0.226844 Oct 17 03:56:38.038297 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 212/422] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:37 2022] GET /compute/v2.1/servers/35e9dd79-985d-4adf-b151-55b1db06469c => generated 1312 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:56:38.114063 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-4d2c75d2-c1c8-4e4d-8a56-7393aa3380ef tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:38.114767 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-4d2c75d2-c1c8-4e4d-8a56-7393aa3380ef tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] [instance: d471c80c-12be-4e18-89d6-d64601602d39] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:38.121726 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-4d2c75d2-c1c8-4e4d-8a56-7393aa3380ef tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:38.122212 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-4d2c75d2-c1c8-4e4d-8a56-7393aa3380ef tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:38.122643 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-4d2c75d2-c1c8-4e4d-8a56-7393aa3380ef tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:38.123369 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-4d2c75d2-c1c8-4e4d-8a56-7393aa3380ef tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:38.123821 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-4d2c75d2-c1c8-4e4d-8a56-7393aa3380ef tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:38.124239 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-4d2c75d2-c1c8-4e4d-8a56-7393aa3380ef tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:38.260197 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-4d2c75d2-c1c8-4e4d-8a56-7393aa3380ef tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b22f27c7144a3d96f41747473fe646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0a418ceb742fdb01c98c5d58424a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:38.269289 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-4d2c75d2-c1c8-4e4d-8a56-7393aa3380ef tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] 10.222.0.16 "GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39" status: 200 len: 1258 microversion: 2.1 time: 0.158016 Oct 17 03:56:38.269289 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 211/423] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:38 2022] GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39 => generated 1258 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:56:38.519976 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-d8c7ec5d-3c49-48b6-84db-5796cddfd3c4 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:38.520694 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-d8c7ec5d-3c49-48b6-84db-5796cddfd3c4 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:38.522743 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_cell0:SELECT=2 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:56:38.523419 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_cell0:SELECT=6 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:56:38.529625 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d8c7ec5d-3c49-48b6-84db-5796cddfd3c4 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:38.530104 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d8c7ec5d-3c49-48b6-84db-5796cddfd3c4 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:38.530540 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d8c7ec5d-3c49-48b6-84db-5796cddfd3c4 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:38.531251 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d8c7ec5d-3c49-48b6-84db-5796cddfd3c4 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:38.531706 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d8c7ec5d-3c49-48b6-84db-5796cddfd3c4 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:38.532127 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d8c7ec5d-3c49-48b6-84db-5796cddfd3c4 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:38.670607 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-d8c7ec5d-3c49-48b6-84db-5796cddfd3c4 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:38.678639 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-d8c7ec5d-3c49-48b6-84db-5796cddfd3c4 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:38.680119 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-d8c7ec5d-3c49-48b6-84db-5796cddfd3c4 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:38.681268 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-d8c7ec5d-3c49-48b6-84db-5796cddfd3c4 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1723 microversion: 2.20 time: 0.165958 Oct 17 03:56:38.681831 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 213/424] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:56:38 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:56:39.061778 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-03f9d00b-9b4b-41f0-9f73-7cd070b6e5b7 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:39.062400 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-03f9d00b-9b4b-41f0-9f73-7cd070b6e5b7 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] [instance: 35e9dd79-985d-4adf-b151-55b1db06469c] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:39.068858 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-03f9d00b-9b4b-41f0-9f73-7cd070b6e5b7 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:39.069781 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-03f9d00b-9b4b-41f0-9f73-7cd070b6e5b7 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:39.069781 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-03f9d00b-9b4b-41f0-9f73-7cd070b6e5b7 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:39.070442 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-03f9d00b-9b4b-41f0-9f73-7cd070b6e5b7 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:39.070899 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-03f9d00b-9b4b-41f0-9f73-7cd070b6e5b7 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:39.071362 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-03f9d00b-9b4b-41f0-9f73-7cd070b6e5b7 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:39.201514 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-03f9d00b-9b4b-41f0-9f73-7cd070b6e5b7 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a421a2a8899342b38aa61676f3b7bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7543f344fc54e41836865a828c4754d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:39.209301 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-03f9d00b-9b4b-41f0-9f73-7cd070b6e5b7 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] 10.222.0.16 "GET /compute/v2.1/servers/35e9dd79-985d-4adf-b151-55b1db06469c" status: 200 len: 1312 microversion: 2.1 time: 0.151869 Oct 17 03:56:39.209862 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 212/425] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:39 2022] GET /compute/v2.1/servers/35e9dd79-985d-4adf-b151-55b1db06469c => generated 1312 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:56:39.289785 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-7e8ca3b6-26b0-4bea-ad88-b4249a234185 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:39.290433 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-7e8ca3b6-26b0-4bea-ad88-b4249a234185 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] [instance: d471c80c-12be-4e18-89d6-d64601602d39] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:39.297459 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7e8ca3b6-26b0-4bea-ad88-b4249a234185 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:39.297944 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7e8ca3b6-26b0-4bea-ad88-b4249a234185 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:39.298384 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7e8ca3b6-26b0-4bea-ad88-b4249a234185 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:39.299097 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7e8ca3b6-26b0-4bea-ad88-b4249a234185 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:39.299639 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7e8ca3b6-26b0-4bea-ad88-b4249a234185 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:39.300062 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7e8ca3b6-26b0-4bea-ad88-b4249a234185 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:39.428236 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-7e8ca3b6-26b0-4bea-ad88-b4249a234185 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b22f27c7144a3d96f41747473fe646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0a418ceb742fdb01c98c5d58424a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:39.435940 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-7e8ca3b6-26b0-4bea-ad88-b4249a234185 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] 10.222.0.16 "GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39" status: 200 len: 1258 microversion: 2.1 time: 0.150021 Oct 17 03:56:39.436503 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 214/426] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:39 2022] GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39 => generated 1258 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:56:39.706209 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-d55b6460-38df-4b15-b185-18a58fcdaa1e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:39.706828 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-d55b6460-38df-4b15-b185-18a58fcdaa1e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:39.712726 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d55b6460-38df-4b15-b185-18a58fcdaa1e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:39.714733 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d55b6460-38df-4b15-b185-18a58fcdaa1e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:39.714733 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d55b6460-38df-4b15-b185-18a58fcdaa1e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:39.714938 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d55b6460-38df-4b15-b185-18a58fcdaa1e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:39.715358 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d55b6460-38df-4b15-b185-18a58fcdaa1e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:39.715786 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d55b6460-38df-4b15-b185-18a58fcdaa1e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:39.849512 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-d55b6460-38df-4b15-b185-18a58fcdaa1e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:39.858225 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-d55b6460-38df-4b15-b185-18a58fcdaa1e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:39.859893 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-d55b6460-38df-4b15-b185-18a58fcdaa1e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:39.861071 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-d55b6460-38df-4b15-b185-18a58fcdaa1e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1723 microversion: 2.20 time: 0.158894 Oct 17 03:56:39.861628 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 213/427] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:56:39 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:56:40.232089 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-eb49ddcf-26c9-459e-b13c-f8db204424fc tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:40.232698 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-eb49ddcf-26c9-459e-b13c-f8db204424fc tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] [instance: 35e9dd79-985d-4adf-b151-55b1db06469c] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:40.239093 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-eb49ddcf-26c9-459e-b13c-f8db204424fc tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:40.239610 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-eb49ddcf-26c9-459e-b13c-f8db204424fc tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:40.240042 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-eb49ddcf-26c9-459e-b13c-f8db204424fc tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:40.240727 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-eb49ddcf-26c9-459e-b13c-f8db204424fc tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:40.241174 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-eb49ddcf-26c9-459e-b13c-f8db204424fc tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:40.241592 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-eb49ddcf-26c9-459e-b13c-f8db204424fc tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:40.371565 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-eb49ddcf-26c9-459e-b13c-f8db204424fc tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a421a2a8899342b38aa61676f3b7bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7543f344fc54e41836865a828c4754d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:40.379560 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-eb49ddcf-26c9-459e-b13c-f8db204424fc tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] 10.222.0.16 "GET /compute/v2.1/servers/35e9dd79-985d-4adf-b151-55b1db06469c" status: 200 len: 1312 microversion: 2.1 time: 0.151808 Oct 17 03:56:40.380139 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 215/428] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:40 2022] GET /compute/v2.1/servers/35e9dd79-985d-4adf-b151-55b1db06469c => generated 1312 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:56:40.459542 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-044b093f-bbc3-479a-b3f2-4ba95fbd7eda tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:40.460154 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-044b093f-bbc3-479a-b3f2-4ba95fbd7eda tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] [instance: d471c80c-12be-4e18-89d6-d64601602d39] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:40.466567 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-044b093f-bbc3-479a-b3f2-4ba95fbd7eda tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:40.467047 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-044b093f-bbc3-479a-b3f2-4ba95fbd7eda tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:40.467522 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-044b093f-bbc3-479a-b3f2-4ba95fbd7eda tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:40.468210 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-044b093f-bbc3-479a-b3f2-4ba95fbd7eda tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:40.468665 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-044b093f-bbc3-479a-b3f2-4ba95fbd7eda tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:40.469091 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-044b093f-bbc3-479a-b3f2-4ba95fbd7eda tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:40.607979 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-044b093f-bbc3-479a-b3f2-4ba95fbd7eda tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b22f27c7144a3d96f41747473fe646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0a418ceb742fdb01c98c5d58424a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:40.616042 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-044b093f-bbc3-479a-b3f2-4ba95fbd7eda tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] 10.222.0.16 "GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39" status: 200 len: 1258 microversion: 2.1 time: 0.160342 Oct 17 03:56:40.620282 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 214/429] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:40 2022] GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39 => generated 1258 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:56:40.886563 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-2eba40cd-c6d6-44e6-be50-9f8dda4a0570 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:40.887372 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-2eba40cd-c6d6-44e6-be50-9f8dda4a0570 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:40.894027 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2eba40cd-c6d6-44e6-be50-9f8dda4a0570 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:40.896914 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2eba40cd-c6d6-44e6-be50-9f8dda4a0570 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:40.896914 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2eba40cd-c6d6-44e6-be50-9f8dda4a0570 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:40.896914 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2eba40cd-c6d6-44e6-be50-9f8dda4a0570 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:40.896914 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2eba40cd-c6d6-44e6-be50-9f8dda4a0570 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:40.897517 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2eba40cd-c6d6-44e6-be50-9f8dda4a0570 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:40.916327 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_cell1:SELECT=100 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:56:40.998496 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [req-a2106d5e-461c-4a89-9721-0f3f2312e877 req-09f177db-4982-4848-95f4-a754740c6b73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d471c80c-12be-4e18-89d6-d64601602d39", "name": "network-vif-plugged", "status": "completed", "tag": "63565771-2da1-4fe4-a238-2f393636b21d"}]} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:56:41.006014 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_cell0:SELECT=2 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:56:41.007247 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_cell0:SELECT=10 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:56:41.011537 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-a2106d5e-461c-4a89-9721-0f3f2312e877 req-09f177db-4982-4848-95f4-a754740c6b73 service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:41.011936 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-a2106d5e-461c-4a89-9721-0f3f2312e877 req-09f177db-4982-4848-95f4-a754740c6b73 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:41.012363 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-a2106d5e-461c-4a89-9721-0f3f2312e877 req-09f177db-4982-4848-95f4-a754740c6b73 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:41.023192 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.compute.server_external_events [req-a2106d5e-461c-4a89-9721-0f3f2312e877 req-09f177db-4982-4848-95f4-a754740c6b73 service nova] Creating event network-vif-plugged:63565771-2da1-4fe4-a238-2f393636b21d for instance d471c80c-12be-4e18-89d6-d64601602d39 on hv-cinder-81558 Oct 17 03:56:41.028567 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-2eba40cd-c6d6-44e6-be50-9f8dda4a0570 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:41.028791 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [req-a2106d5e-461c-4a89-9721-0f3f2312e877 req-09f177db-4982-4848-95f4-a754740c6b73 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033710 Oct 17 03:56:41.029219 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 215/430] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 03:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 03:56:41.036752 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-2eba40cd-c6d6-44e6-be50-9f8dda4a0570 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:41.038191 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-2eba40cd-c6d6-44e6-be50-9f8dda4a0570 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:41.039367 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-2eba40cd-c6d6-44e6-be50-9f8dda4a0570 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1723 microversion: 2.20 time: 0.157561 Oct 17 03:56:41.040784 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 216/431] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:56:40 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:56:41.402730 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-36fdc5ff-b94e-4a9e-994b-7ebd12825909 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:41.403497 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-36fdc5ff-b94e-4a9e-994b-7ebd12825909 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] [instance: 35e9dd79-985d-4adf-b151-55b1db06469c] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:41.410308 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-36fdc5ff-b94e-4a9e-994b-7ebd12825909 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:41.410786 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-36fdc5ff-b94e-4a9e-994b-7ebd12825909 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:41.411238 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-36fdc5ff-b94e-4a9e-994b-7ebd12825909 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:41.411932 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-36fdc5ff-b94e-4a9e-994b-7ebd12825909 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:41.412387 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-36fdc5ff-b94e-4a9e-994b-7ebd12825909 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:41.412805 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-36fdc5ff-b94e-4a9e-994b-7ebd12825909 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:41.548905 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-36fdc5ff-b94e-4a9e-994b-7ebd12825909 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a421a2a8899342b38aa61676f3b7bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7543f344fc54e41836865a828c4754d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:41.557156 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-36fdc5ff-b94e-4a9e-994b-7ebd12825909 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] 10.222.0.16 "GET /compute/v2.1/servers/35e9dd79-985d-4adf-b151-55b1db06469c" status: 200 len: 1312 microversion: 2.1 time: 0.158988 Oct 17 03:56:41.562934 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 216/432] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:41 2022] GET /compute/v2.1/servers/35e9dd79-985d-4adf-b151-55b1db06469c => generated 1312 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:56:41.639263 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-db0bc27e-3d2b-4ba3-975a-407360500e99 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:41.639879 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-db0bc27e-3d2b-4ba3-975a-407360500e99 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] [instance: d471c80c-12be-4e18-89d6-d64601602d39] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:41.646371 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-db0bc27e-3d2b-4ba3-975a-407360500e99 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:41.650474 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-db0bc27e-3d2b-4ba3-975a-407360500e99 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:41.650474 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-db0bc27e-3d2b-4ba3-975a-407360500e99 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:41.650474 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-db0bc27e-3d2b-4ba3-975a-407360500e99 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:41.650474 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-db0bc27e-3d2b-4ba3-975a-407360500e99 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:41.650855 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-db0bc27e-3d2b-4ba3-975a-407360500e99 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:41.786703 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-db0bc27e-3d2b-4ba3-975a-407360500e99 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b22f27c7144a3d96f41747473fe646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0a418ceb742fdb01c98c5d58424a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:41.795008 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-db0bc27e-3d2b-4ba3-975a-407360500e99 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] 10.222.0.16 "GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39" status: 200 len: 1258 microversion: 2.1 time: 0.160467 Oct 17 03:56:41.795603 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 217/433] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:41 2022] GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39 => generated 1258 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:56:42.065303 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-389ccf79-e4ea-42cf-9a3e-93b6c811dc8a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:42.065870 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-389ccf79-e4ea-42cf-9a3e-93b6c811dc8a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:42.071879 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-389ccf79-e4ea-42cf-9a3e-93b6c811dc8a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:42.072359 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-389ccf79-e4ea-42cf-9a3e-93b6c811dc8a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:42.072791 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-389ccf79-e4ea-42cf-9a3e-93b6c811dc8a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:42.073520 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-389ccf79-e4ea-42cf-9a3e-93b6c811dc8a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:42.073971 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-389ccf79-e4ea-42cf-9a3e-93b6c811dc8a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:42.074390 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-389ccf79-e4ea-42cf-9a3e-93b6c811dc8a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:42.199298 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-389ccf79-e4ea-42cf-9a3e-93b6c811dc8a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:42.207245 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-389ccf79-e4ea-42cf-9a3e-93b6c811dc8a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:42.208679 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-389ccf79-e4ea-42cf-9a3e-93b6c811dc8a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:42.209829 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-389ccf79-e4ea-42cf-9a3e-93b6c811dc8a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1723 microversion: 2.20 time: 0.148581 Oct 17 03:56:42.210387 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 217/434] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:56:42 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:56:42.580691 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-576f5657-a964-4cae-a511-784043d870e4 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:42.581264 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-576f5657-a964-4cae-a511-784043d870e4 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] [instance: 35e9dd79-985d-4adf-b151-55b1db06469c] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:42.587255 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-576f5657-a964-4cae-a511-784043d870e4 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:42.587747 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-576f5657-a964-4cae-a511-784043d870e4 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:42.588187 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-576f5657-a964-4cae-a511-784043d870e4 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:42.588884 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-576f5657-a964-4cae-a511-784043d870e4 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:42.589930 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-576f5657-a964-4cae-a511-784043d870e4 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:42.590361 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-576f5657-a964-4cae-a511-784043d870e4 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:42.722762 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-576f5657-a964-4cae-a511-784043d870e4 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a421a2a8899342b38aa61676f3b7bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7543f344fc54e41836865a828c4754d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:42.730326 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-576f5657-a964-4cae-a511-784043d870e4 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] 10.222.0.16 "GET /compute/v2.1/servers/35e9dd79-985d-4adf-b151-55b1db06469c" status: 200 len: 1312 microversion: 2.1 time: 0.153707 Oct 17 03:56:42.730895 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 218/435] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:42 2022] GET /compute/v2.1/servers/35e9dd79-985d-4adf-b151-55b1db06469c => generated 1312 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:56:42.818219 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-98f8ccb7-d8d9-4b69-91d4-abeab2ddd75a tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:42.819069 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-98f8ccb7-d8d9-4b69-91d4-abeab2ddd75a tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] [instance: d471c80c-12be-4e18-89d6-d64601602d39] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:42.826220 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-98f8ccb7-d8d9-4b69-91d4-abeab2ddd75a tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:42.826783 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-98f8ccb7-d8d9-4b69-91d4-abeab2ddd75a tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:42.827244 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-98f8ccb7-d8d9-4b69-91d4-abeab2ddd75a tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:42.827937 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-98f8ccb7-d8d9-4b69-91d4-abeab2ddd75a tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:42.828391 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-98f8ccb7-d8d9-4b69-91d4-abeab2ddd75a tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:42.828954 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-98f8ccb7-d8d9-4b69-91d4-abeab2ddd75a tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:42.846951 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_cell1:SELECT=100 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:56:42.956580 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-98f8ccb7-d8d9-4b69-91d4-abeab2ddd75a tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b22f27c7144a3d96f41747473fe646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0a418ceb742fdb01c98c5d58424a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:42.964677 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-98f8ccb7-d8d9-4b69-91d4-abeab2ddd75a tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] 10.222.0.16 "GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39" status: 200 len: 1258 microversion: 2.1 time: 0.150260 Oct 17 03:56:42.965427 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 218/436] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:42 2022] GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39 => generated 1258 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:56:43.236045 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-b338d5b7-15a0-4a69-9e1f-91c4571369f6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:43.236658 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-b338d5b7-15a0-4a69-9e1f-91c4571369f6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:43.242559 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b338d5b7-15a0-4a69-9e1f-91c4571369f6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:43.243038 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b338d5b7-15a0-4a69-9e1f-91c4571369f6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:43.243505 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b338d5b7-15a0-4a69-9e1f-91c4571369f6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:43.244191 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b338d5b7-15a0-4a69-9e1f-91c4571369f6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:43.244644 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b338d5b7-15a0-4a69-9e1f-91c4571369f6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:43.245067 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b338d5b7-15a0-4a69-9e1f-91c4571369f6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:43.373776 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-b338d5b7-15a0-4a69-9e1f-91c4571369f6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:43.381946 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-b338d5b7-15a0-4a69-9e1f-91c4571369f6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:43.383529 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-b338d5b7-15a0-4a69-9e1f-91c4571369f6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:43.385174 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-b338d5b7-15a0-4a69-9e1f-91c4571369f6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1723 microversion: 2.20 time: 0.152649 Oct 17 03:56:43.385810 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 219/437] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:56:43 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:56:43.752863 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-076cea06-e38f-41a3-a693-08814480c967 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:43.753481 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-076cea06-e38f-41a3-a693-08814480c967 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] [instance: 35e9dd79-985d-4adf-b151-55b1db06469c] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:43.760018 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-076cea06-e38f-41a3-a693-08814480c967 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:43.760413 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-076cea06-e38f-41a3-a693-08814480c967 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:43.760844 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-076cea06-e38f-41a3-a693-08814480c967 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:43.761543 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-076cea06-e38f-41a3-a693-08814480c967 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:43.762373 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-076cea06-e38f-41a3-a693-08814480c967 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:43.762373 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-076cea06-e38f-41a3-a693-08814480c967 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:43.891507 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-076cea06-e38f-41a3-a693-08814480c967 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a421a2a8899342b38aa61676f3b7bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7543f344fc54e41836865a828c4754d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:43.899217 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-076cea06-e38f-41a3-a693-08814480c967 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] 10.222.0.16 "GET /compute/v2.1/servers/35e9dd79-985d-4adf-b151-55b1db06469c" status: 200 len: 1312 microversion: 2.1 time: 0.150207 Oct 17 03:56:43.899773 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 219/438] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:43 2022] GET /compute/v2.1/servers/35e9dd79-985d-4adf-b151-55b1db06469c => generated 1312 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:56:43.987003 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-e036d4d8-da47-4cc0-b7fc-05b2102b909b tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:43.987688 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-e036d4d8-da47-4cc0-b7fc-05b2102b909b tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] [instance: d471c80c-12be-4e18-89d6-d64601602d39] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:43.994132 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e036d4d8-da47-4cc0-b7fc-05b2102b909b tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:43.994621 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e036d4d8-da47-4cc0-b7fc-05b2102b909b tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:43.995122 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e036d4d8-da47-4cc0-b7fc-05b2102b909b tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:43.995849 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e036d4d8-da47-4cc0-b7fc-05b2102b909b tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:43.996306 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e036d4d8-da47-4cc0-b7fc-05b2102b909b tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:43.996732 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e036d4d8-da47-4cc0-b7fc-05b2102b909b tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:44.123994 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-e036d4d8-da47-4cc0-b7fc-05b2102b909b tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b22f27c7144a3d96f41747473fe646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0a418ceb742fdb01c98c5d58424a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:44.131608 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-e036d4d8-da47-4cc0-b7fc-05b2102b909b tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] 10.222.0.16 "GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39" status: 200 len: 1442 microversion: 2.1 time: 0.148496 Oct 17 03:56:44.132207 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 220/439] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:43 2022] GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39 => generated 1442 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:56:44.154426 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-bd319786-3026-4733-9de6-6d2bde0a157f tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:44.155041 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-bd319786-3026-4733-9de6-6d2bde0a157f tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] [instance: d471c80c-12be-4e18-89d6-d64601602d39] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:44.160894 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-bd319786-3026-4733-9de6-6d2bde0a157f tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:44.161370 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-bd319786-3026-4733-9de6-6d2bde0a157f tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:44.161805 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-bd319786-3026-4733-9de6-6d2bde0a157f tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:44.162495 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-bd319786-3026-4733-9de6-6d2bde0a157f tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:44.162979 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-bd319786-3026-4733-9de6-6d2bde0a157f tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:44.163431 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-bd319786-3026-4733-9de6-6d2bde0a157f tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:44.296511 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-bd319786-3026-4733-9de6-6d2bde0a157f tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b22f27c7144a3d96f41747473fe646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0a418ceb742fdb01c98c5d58424a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:44.304333 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-bd319786-3026-4733-9de6-6d2bde0a157f tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] 10.222.0.16 "GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39" status: 200 len: 1442 microversion: 2.1 time: 0.154234 Oct 17 03:56:44.304901 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 220/440] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:44 2022] GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39 => generated 1442 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:56:44.410978 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-1e0a5740-6f6b-4346-8416-66b31b5e555f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:44.417662 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-1e0a5740-6f6b-4346-8416-66b31b5e555f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:44.425732 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1e0a5740-6f6b-4346-8416-66b31b5e555f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:44.426625 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1e0a5740-6f6b-4346-8416-66b31b5e555f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:44.429893 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1e0a5740-6f6b-4346-8416-66b31b5e555f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:44.429893 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1e0a5740-6f6b-4346-8416-66b31b5e555f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:44.429893 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1e0a5740-6f6b-4346-8416-66b31b5e555f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:44.429893 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1e0a5740-6f6b-4346-8416-66b31b5e555f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:44.568431 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-1e0a5740-6f6b-4346-8416-66b31b5e555f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:44.577034 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-1e0a5740-6f6b-4346-8416-66b31b5e555f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:44.578415 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-1e0a5740-6f6b-4346-8416-66b31b5e555f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:44.579588 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-1e0a5740-6f6b-4346-8416-66b31b5e555f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1723 microversion: 2.20 time: 0.172886 Oct 17 03:56:44.580145 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 221/441] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:56:44 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:56:44.982567 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-aad06e57-6f95-4dc9-8d90-ed1939eee401 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:44.983359 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-aad06e57-6f95-4dc9-8d90-ed1939eee401 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] [instance: 35e9dd79-985d-4adf-b151-55b1db06469c] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:44.989737 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-aad06e57-6f95-4dc9-8d90-ed1939eee401 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:44.990313 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-aad06e57-6f95-4dc9-8d90-ed1939eee401 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:44.990749 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-aad06e57-6f95-4dc9-8d90-ed1939eee401 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:44.991485 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-aad06e57-6f95-4dc9-8d90-ed1939eee401 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:44.991946 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-aad06e57-6f95-4dc9-8d90-ed1939eee401 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:44.992496 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-aad06e57-6f95-4dc9-8d90-ed1939eee401 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:45.053581 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [req-f665e79a-600d-4881-99be-d1fc0716ffdb req-e115d8ce-df2f-4053-8f1c-7bc7e3e20855 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35e9dd79-985d-4adf-b151-55b1db06469c", "name": "network-vif-plugged", "status": "completed", "tag": "e266ae12-156a-4125-94a2-8d0f5d5d867e"}]} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:56:45.065180 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-f665e79a-600d-4881-99be-d1fc0716ffdb req-e115d8ce-df2f-4053-8f1c-7bc7e3e20855 service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:45.065661 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-f665e79a-600d-4881-99be-d1fc0716ffdb req-e115d8ce-df2f-4053-8f1c-7bc7e3e20855 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:45.066088 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-f665e79a-600d-4881-99be-d1fc0716ffdb req-e115d8ce-df2f-4053-8f1c-7bc7e3e20855 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:45.077189 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.compute.server_external_events [req-f665e79a-600d-4881-99be-d1fc0716ffdb req-e115d8ce-df2f-4053-8f1c-7bc7e3e20855 service nova] Creating event network-vif-plugged:e266ae12-156a-4125-94a2-8d0f5d5d867e for instance 35e9dd79-985d-4adf-b151-55b1db06469c on hv-cinder-81558 Oct 17 03:56:45.082627 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [req-f665e79a-600d-4881-99be-d1fc0716ffdb req-e115d8ce-df2f-4053-8f1c-7bc7e3e20855 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032927 Oct 17 03:56:45.083497 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 222/442] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 03:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 03:56:45.213450 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-aad06e57-6f95-4dc9-8d90-ed1939eee401 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a421a2a8899342b38aa61676f3b7bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7543f344fc54e41836865a828c4754d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:45.225151 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-aad06e57-6f95-4dc9-8d90-ed1939eee401 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] 10.222.0.16 "GET /compute/v2.1/servers/35e9dd79-985d-4adf-b151-55b1db06469c" status: 200 len: 1312 microversion: 2.1 time: 0.246079 Oct 17 03:56:45.231215 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 221/443] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:44 2022] GET /compute/v2.1/servers/35e9dd79-985d-4adf-b151-55b1db06469c => generated 1312 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:56:45.534380 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-fa2ef97a-6763-4c9d-99ba-17b04dbf3760 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6ac06077-c340-4a57-85e2-ff15f90f7662", "device": "/dev/sdb"}} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:56:45.537362 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-fa2ef97a-6763-4c9d-99ba-17b04dbf3760 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] [instance: 52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:45.543599 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-fa2ef97a-6763-4c9d-99ba-17b04dbf3760 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:45.544087 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-fa2ef97a-6763-4c9d-99ba-17b04dbf3760 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:45.544537 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-fa2ef97a-6763-4c9d-99ba-17b04dbf3760 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:45.545310 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-fa2ef97a-6763-4c9d-99ba-17b04dbf3760 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:45.545768 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-fa2ef97a-6763-4c9d-99ba-17b04dbf3760 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:45.546205 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-fa2ef97a-6763-4c9d-99ba-17b04dbf3760 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:45.604975 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-353adf18-b2ec-4029-8fd3-f1fdd46891ae tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:45.605696 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-353adf18-b2ec-4029-8fd3-f1fdd46891ae tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:45.611784 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-353adf18-b2ec-4029-8fd3-f1fdd46891ae tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:45.612327 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-353adf18-b2ec-4029-8fd3-f1fdd46891ae tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:45.612863 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-353adf18-b2ec-4029-8fd3-f1fdd46891ae tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:45.613688 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-353adf18-b2ec-4029-8fd3-f1fdd46891ae tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:45.614277 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-353adf18-b2ec-4029-8fd3-f1fdd46891ae tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:45.614895 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-353adf18-b2ec-4029-8fd3-f1fdd46891ae tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:45.860276 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-353adf18-b2ec-4029-8fd3-f1fdd46891ae tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:45.868493 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-353adf18-b2ec-4029-8fd3-f1fdd46891ae tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:45.869867 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-353adf18-b2ec-4029-8fd3-f1fdd46891ae tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:45.871615 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-353adf18-b2ec-4029-8fd3-f1fdd46891ae tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1723 microversion: 2.20 time: 0.270913 Oct 17 03:56:45.872235 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 222/444] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:56:45 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1723 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:56:46.248437 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-5f4d80d2-a250-46ac-8f4d-8129224ce66b tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:46.249164 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-5f4d80d2-a250-46ac-8f4d-8129224ce66b tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] [instance: 35e9dd79-985d-4adf-b151-55b1db06469c] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:46.255784 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-5f4d80d2-a250-46ac-8f4d-8129224ce66b tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:46.256269 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-5f4d80d2-a250-46ac-8f4d-8129224ce66b tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:46.256703 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-5f4d80d2-a250-46ac-8f4d-8129224ce66b tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:46.257406 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-5f4d80d2-a250-46ac-8f4d-8129224ce66b tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:46.257859 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-5f4d80d2-a250-46ac-8f4d-8129224ce66b tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:46.258280 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-5f4d80d2-a250-46ac-8f4d-8129224ce66b tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:46.386231 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-fa2ef97a-6763-4c9d-99ba-17b04dbf3760 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] 10.222.0.16 "POST /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.855451 Oct 17 03:56:46.386976 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 223/445] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Oct 17 03:56:45 2022] POST /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0/os-volume_attachments => generated 194 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:56:46.498273 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-5f4d80d2-a250-46ac-8f4d-8129224ce66b tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a421a2a8899342b38aa61676f3b7bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7543f344fc54e41836865a828c4754d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:46.506038 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-5f4d80d2-a250-46ac-8f4d-8129224ce66b tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] 10.222.0.16 "GET /compute/v2.1/servers/35e9dd79-985d-4adf-b151-55b1db06469c" status: 200 len: 1312 microversion: 2.1 time: 0.261460 Oct 17 03:56:46.506591 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 223/446] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:46 2022] GET /compute/v2.1/servers/35e9dd79-985d-4adf-b151-55b1db06469c => generated 1312 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:56:46.887755 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [req-2131df48-99ed-4d33-9516-0d8e827eb7c6 req-a13f338b-bf14-486b-8e98-3adad585d6f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d471c80c-12be-4e18-89d6-d64601602d39", "tag": "63565771-2da1-4fe4-a238-2f393636b21d"}]} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:56:46.897565 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-b2e512df-dbcd-4d8b-9c7e-87b4868bc802 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:46.898038 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-2131df48-99ed-4d33-9516-0d8e827eb7c6 req-a13f338b-bf14-486b-8e98-3adad585d6f8 service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:46.898174 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-b2e512df-dbcd-4d8b-9c7e-87b4868bc802 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:46.898534 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-2131df48-99ed-4d33-9516-0d8e827eb7c6 req-a13f338b-bf14-486b-8e98-3adad585d6f8 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:46.899142 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-2131df48-99ed-4d33-9516-0d8e827eb7c6 req-a13f338b-bf14-486b-8e98-3adad585d6f8 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:46.905109 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b2e512df-dbcd-4d8b-9c7e-87b4868bc802 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:46.905533 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b2e512df-dbcd-4d8b-9c7e-87b4868bc802 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:46.905961 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b2e512df-dbcd-4d8b-9c7e-87b4868bc802 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:46.906855 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b2e512df-dbcd-4d8b-9c7e-87b4868bc802 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:46.907494 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b2e512df-dbcd-4d8b-9c7e-87b4868bc802 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:46.908074 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b2e512df-dbcd-4d8b-9c7e-87b4868bc802 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:46.932325 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.compute.server_external_events [req-2131df48-99ed-4d33-9516-0d8e827eb7c6 req-a13f338b-bf14-486b-8e98-3adad585d6f8 service nova] Creating event network-changed:63565771-2da1-4fe4-a238-2f393636b21d for instance d471c80c-12be-4e18-89d6-d64601602d39 on hv-cinder-81558 Oct 17 03:56:46.942392 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [req-2131df48-99ed-4d33-9516-0d8e827eb7c6 req-a13f338b-bf14-486b-8e98-3adad585d6f8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060179 Oct 17 03:56:46.942993 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 224/447] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 03:56:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:56:47.049996 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-b2e512df-dbcd-4d8b-9c7e-87b4868bc802 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:47.059087 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-b2e512df-dbcd-4d8b-9c7e-87b4868bc802 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:47.060562 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-b2e512df-dbcd-4d8b-9c7e-87b4868bc802 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:47.061720 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-b2e512df-dbcd-4d8b-9c7e-87b4868bc802 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1723 microversion: 2.20 time: 0.168224 Oct 17 03:56:47.062287 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 224/448] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:56:46 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:56:47.531401 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-2991af79-303c-4ae2-9941-13eb401c13d1 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:47.535213 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-2991af79-303c-4ae2-9941-13eb401c13d1 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] [instance: 35e9dd79-985d-4adf-b151-55b1db06469c] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:47.539117 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2991af79-303c-4ae2-9941-13eb401c13d1 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:47.539634 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2991af79-303c-4ae2-9941-13eb401c13d1 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:47.540069 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2991af79-303c-4ae2-9941-13eb401c13d1 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:47.540773 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2991af79-303c-4ae2-9941-13eb401c13d1 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:47.541229 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2991af79-303c-4ae2-9941-13eb401c13d1 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:47.541667 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2991af79-303c-4ae2-9941-13eb401c13d1 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:47.677374 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-2991af79-303c-4ae2-9941-13eb401c13d1 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a421a2a8899342b38aa61676f3b7bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7543f344fc54e41836865a828c4754d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:47.685511 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-2991af79-303c-4ae2-9941-13eb401c13d1 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] 10.222.0.16 "GET /compute/v2.1/servers/35e9dd79-985d-4adf-b151-55b1db06469c" status: 200 len: 1496 microversion: 2.1 time: 0.159050 Oct 17 03:56:47.686112 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 225/449] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:47 2022] GET /compute/v2.1/servers/35e9dd79-985d-4adf-b151-55b1db06469c => generated 1496 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:56:48.087491 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-43cab8de-035f-48b4-8f6c-0a70f6bea4e7 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:48.088109 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-43cab8de-035f-48b4-8f6c-0a70f6bea4e7 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:48.094350 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-43cab8de-035f-48b4-8f6c-0a70f6bea4e7 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:48.094826 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-43cab8de-035f-48b4-8f6c-0a70f6bea4e7 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:48.095284 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-43cab8de-035f-48b4-8f6c-0a70f6bea4e7 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:48.095969 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-43cab8de-035f-48b4-8f6c-0a70f6bea4e7 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:48.096417 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-43cab8de-035f-48b4-8f6c-0a70f6bea4e7 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:48.097337 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-43cab8de-035f-48b4-8f6c-0a70f6bea4e7 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:48.233301 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-43cab8de-035f-48b4-8f6c-0a70f6bea4e7 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:48.241905 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-43cab8de-035f-48b4-8f6c-0a70f6bea4e7 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:48.243370 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-43cab8de-035f-48b4-8f6c-0a70f6bea4e7 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:48.255353 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-43cab8de-035f-48b4-8f6c-0a70f6bea4e7 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1723 microversion: 2.20 time: 0.161250 Oct 17 03:56:48.255353 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 225/450] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:56:48 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:56:48.555739 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-ea491002-c231-4fc3-9680-ec16c2f57ca6 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:48.556445 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-ea491002-c231-4fc3-9680-ec16c2f57ca6 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] [instance: 35e9dd79-985d-4adf-b151-55b1db06469c] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:48.563366 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ea491002-c231-4fc3-9680-ec16c2f57ca6 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:48.567580 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ea491002-c231-4fc3-9680-ec16c2f57ca6 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:48.567580 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ea491002-c231-4fc3-9680-ec16c2f57ca6 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:48.567580 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ea491002-c231-4fc3-9680-ec16c2f57ca6 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:48.567580 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ea491002-c231-4fc3-9680-ec16c2f57ca6 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:48.568234 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ea491002-c231-4fc3-9680-ec16c2f57ca6 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:48.597028 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-ea491002-c231-4fc3-9680-ec16c2f57ca6 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] [instance: 35e9dd79-985d-4adf-b151-55b1db06469c] Going to try to terminate instance {{(pid=125871) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 03:56:48.856116 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-ea491002-c231-4fc3-9680-ec16c2f57ca6 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] 10.222.0.16 "DELETE /compute/v2.1/servers/35e9dd79-985d-4adf-b151-55b1db06469c" status: 204 len: 0 microversion: 2.1 time: 0.303205 Oct 17 03:56:48.856698 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 226/451] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 17 03:56:48 2022] DELETE /compute/v2.1/servers/35e9dd79-985d-4adf-b151-55b1db06469c => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 03:56:48.864680 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-6bc1c5ff-4bfc-4893-9291-0f0440f628ff tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:48.867334 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-6bc1c5ff-4bfc-4893-9291-0f0440f628ff tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] [instance: 35e9dd79-985d-4adf-b151-55b1db06469c] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:48.871410 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6bc1c5ff-4bfc-4893-9291-0f0440f628ff tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:48.871893 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6bc1c5ff-4bfc-4893-9291-0f0440f628ff tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:48.872324 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6bc1c5ff-4bfc-4893-9291-0f0440f628ff tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:48.873012 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6bc1c5ff-4bfc-4893-9291-0f0440f628ff tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:48.873463 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6bc1c5ff-4bfc-4893-9291-0f0440f628ff tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:48.873951 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6bc1c5ff-4bfc-4893-9291-0f0440f628ff tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:49.009379 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-6bc1c5ff-4bfc-4893-9291-0f0440f628ff tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a421a2a8899342b38aa61676f3b7bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7543f344fc54e41836865a828c4754d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:49.017553 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-6bc1c5ff-4bfc-4893-9291-0f0440f628ff tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] 10.222.0.16 "GET /compute/v2.1/servers/35e9dd79-985d-4adf-b151-55b1db06469c" status: 200 len: 1502 microversion: 2.1 time: 0.156584 Oct 17 03:56:49.018138 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 226/452] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:48 2022] GET /compute/v2.1/servers/35e9dd79-985d-4adf-b151-55b1db06469c => generated 1502 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:56:49.272408 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-42266b11-0548-4dda-ae40-ec46c555af37 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:49.273041 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-42266b11-0548-4dda-ae40-ec46c555af37 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:49.279537 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-42266b11-0548-4dda-ae40-ec46c555af37 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:49.280011 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-42266b11-0548-4dda-ae40-ec46c555af37 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:49.280438 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-42266b11-0548-4dda-ae40-ec46c555af37 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:49.281117 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-42266b11-0548-4dda-ae40-ec46c555af37 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:49.281565 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-42266b11-0548-4dda-ae40-ec46c555af37 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:49.281980 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-42266b11-0548-4dda-ae40-ec46c555af37 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:49.405814 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-42266b11-0548-4dda-ae40-ec46c555af37 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:49.413689 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-42266b11-0548-4dda-ae40-ec46c555af37 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:49.415120 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-42266b11-0548-4dda-ae40-ec46c555af37 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:49.416284 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-42266b11-0548-4dda-ae40-ec46c555af37 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1744 microversion: 2.20 time: 0.148231 Oct 17 03:56:49.416836 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 227/453] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:56:49 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1744 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:56:50.041335 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-c230e2b7-7f44-4039-9ee4-65890400a211 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:50.041952 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-c230e2b7-7f44-4039-9ee4-65890400a211 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] [instance: 35e9dd79-985d-4adf-b151-55b1db06469c] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:50.048428 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c230e2b7-7f44-4039-9ee4-65890400a211 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:50.048910 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c230e2b7-7f44-4039-9ee4-65890400a211 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:50.049348 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c230e2b7-7f44-4039-9ee4-65890400a211 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:50.050038 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c230e2b7-7f44-4039-9ee4-65890400a211 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:50.050493 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c230e2b7-7f44-4039-9ee4-65890400a211 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:50.050921 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c230e2b7-7f44-4039-9ee4-65890400a211 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:50.175899 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-c230e2b7-7f44-4039-9ee4-65890400a211 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a421a2a8899342b38aa61676f3b7bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7543f344fc54e41836865a828c4754d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:50.183896 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-c230e2b7-7f44-4039-9ee4-65890400a211 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] 10.222.0.16 "GET /compute/v2.1/servers/35e9dd79-985d-4adf-b151-55b1db06469c" status: 200 len: 1502 microversion: 2.1 time: 0.146425 Oct 17 03:56:50.184489 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 227/454] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:50 2022] GET /compute/v2.1/servers/35e9dd79-985d-4adf-b151-55b1db06469c => generated 1502 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:56:50.441529 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-dc815c17-9d64-46d8-b42a-40159b66d498 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:50.442147 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-dc815c17-9d64-46d8-b42a-40159b66d498 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:50.444627 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:56:50.450176 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-dc815c17-9d64-46d8-b42a-40159b66d498 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:50.450665 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-dc815c17-9d64-46d8-b42a-40159b66d498 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:50.451101 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-dc815c17-9d64-46d8-b42a-40159b66d498 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:50.451824 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-dc815c17-9d64-46d8-b42a-40159b66d498 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:50.452280 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-dc815c17-9d64-46d8-b42a-40159b66d498 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:50.452703 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-dc815c17-9d64-46d8-b42a-40159b66d498 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:50.639474 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-dc815c17-9d64-46d8-b42a-40159b66d498 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:50.647816 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-dc815c17-9d64-46d8-b42a-40159b66d498 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:50.649276 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-dc815c17-9d64-46d8-b42a-40159b66d498 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:50.650441 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-dc815c17-9d64-46d8-b42a-40159b66d498 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1744 microversion: 2.20 time: 0.212844 Oct 17 03:56:50.651022 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 228/455] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:56:50 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1744 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:56:51.208319 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-d394f5b4-2bc2-42f9-9967-98657c11d2aa tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:51.208889 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-d394f5b4-2bc2-42f9-9967-98657c11d2aa tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] [instance: 35e9dd79-985d-4adf-b151-55b1db06469c] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:51.216133 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d394f5b4-2bc2-42f9-9967-98657c11d2aa tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:51.216628 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d394f5b4-2bc2-42f9-9967-98657c11d2aa tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:51.217063 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d394f5b4-2bc2-42f9-9967-98657c11d2aa tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:51.217773 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d394f5b4-2bc2-42f9-9967-98657c11d2aa tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:51.218225 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d394f5b4-2bc2-42f9-9967-98657c11d2aa tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:51.218646 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d394f5b4-2bc2-42f9-9967-98657c11d2aa tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:51.361835 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-d394f5b4-2bc2-42f9-9967-98657c11d2aa tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a421a2a8899342b38aa61676f3b7bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7543f344fc54e41836865a828c4754d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:51.369909 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-d394f5b4-2bc2-42f9-9967-98657c11d2aa tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] 10.222.0.16 "GET /compute/v2.1/servers/35e9dd79-985d-4adf-b151-55b1db06469c" status: 200 len: 1502 microversion: 2.1 time: 0.165495 Oct 17 03:56:51.372386 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 228/456] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:51 2022] GET /compute/v2.1/servers/35e9dd79-985d-4adf-b151-55b1db06469c => generated 1502 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:56:51.678484 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [req-bb7a5c95-6b98-493b-9f36-52f3b0314b3d req-4b5c7be3-3cf8-46a2-ac24-a19dd0f5ad98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35e9dd79-985d-4adf-b151-55b1db06469c", "name": "network-vif-deleted", "tag": "e266ae12-156a-4125-94a2-8d0f5d5d867e"}]} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:56:51.679415 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-ae960952-bee1-46db-8836-60da1647c3eb tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:51.680237 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-ae960952-bee1-46db-8836-60da1647c3eb tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:51.688742 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-bb7a5c95-6b98-493b-9f36-52f3b0314b3d req-4b5c7be3-3cf8-46a2-ac24-a19dd0f5ad98 service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:51.689226 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-bb7a5c95-6b98-493b-9f36-52f3b0314b3d req-4b5c7be3-3cf8-46a2-ac24-a19dd0f5ad98 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:51.689651 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-bb7a5c95-6b98-493b-9f36-52f3b0314b3d req-4b5c7be3-3cf8-46a2-ac24-a19dd0f5ad98 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:51.693931 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ae960952-bee1-46db-8836-60da1647c3eb tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:51.694732 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ae960952-bee1-46db-8836-60da1647c3eb tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:51.695636 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ae960952-bee1-46db-8836-60da1647c3eb tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:51.696938 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ae960952-bee1-46db-8836-60da1647c3eb tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:51.697412 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ae960952-bee1-46db-8836-60da1647c3eb tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:51.697849 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ae960952-bee1-46db-8836-60da1647c3eb tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:51.701915 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.compute.server_external_events [req-bb7a5c95-6b98-493b-9f36-52f3b0314b3d req-4b5c7be3-3cf8-46a2-ac24-a19dd0f5ad98 service nova] Creating event network-vif-deleted:e266ae12-156a-4125-94a2-8d0f5d5d867e for instance 35e9dd79-985d-4adf-b151-55b1db06469c on hv-cinder-81558 Oct 17 03:56:51.707701 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [req-bb7a5c95-6b98-493b-9f36-52f3b0314b3d req-4b5c7be3-3cf8-46a2-ac24-a19dd0f5ad98 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032689 Oct 17 03:56:51.708296 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 229/457] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 03:56:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:56:51.849572 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-ae960952-bee1-46db-8836-60da1647c3eb tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:51.860037 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-ae960952-bee1-46db-8836-60da1647c3eb tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:51.861484 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-ae960952-bee1-46db-8836-60da1647c3eb tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:51.863136 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-ae960952-bee1-46db-8836-60da1647c3eb tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1744 microversion: 2.20 time: 0.188080 Oct 17 03:56:51.864237 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 229/458] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:56:51 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1744 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:56:52.403023 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-12d1af2a-c546-40c6-91fb-9fc724d0871b tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:52.403747 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-12d1af2a-c546-40c6-91fb-9fc724d0871b tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] [instance: 35e9dd79-985d-4adf-b151-55b1db06469c] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:52.410249 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-12d1af2a-c546-40c6-91fb-9fc724d0871b tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:52.410733 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-12d1af2a-c546-40c6-91fb-9fc724d0871b tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:52.411279 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-12d1af2a-c546-40c6-91fb-9fc724d0871b tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:52.412219 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-12d1af2a-c546-40c6-91fb-9fc724d0871b tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:52.412856 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-12d1af2a-c546-40c6-91fb-9fc724d0871b tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:52.413738 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-12d1af2a-c546-40c6-91fb-9fc724d0871b tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:52.458759 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-12d1af2a-c546-40c6-91fb-9fc724d0871b tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:52.459661 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-12d1af2a-c546-40c6-91fb-9fc724d0871b tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:52.462660 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-12d1af2a-c546-40c6-91fb-9fc724d0871b tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:52.463540 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.objects.instance [None req-12d1af2a-c546-40c6-91fb-9fc724d0871b tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lazy-loading 'fault' on Instance uuid 35e9dd79-985d-4adf-b151-55b1db06469c {{(pid=125871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:56:52.546714 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-12d1af2a-c546-40c6-91fb-9fc724d0871b tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a421a2a8899342b38aa61676f3b7bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7543f344fc54e41836865a828c4754d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:52.559711 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-12d1af2a-c546-40c6-91fb-9fc724d0871b tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] 10.222.0.16 "GET /compute/v2.1/servers/35e9dd79-985d-4adf-b151-55b1db06469c" status: 200 len: 1302 microversion: 2.1 time: 0.162254 Oct 17 03:56:52.560325 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 230/459] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:52 2022] GET /compute/v2.1/servers/35e9dd79-985d-4adf-b151-55b1db06469c => generated 1302 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:56:52.889817 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-c7beaec6-6a23-4146-ba80-f6aa1e6c0943 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:52.890392 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-c7beaec6-6a23-4146-ba80-f6aa1e6c0943 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:52.896880 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c7beaec6-6a23-4146-ba80-f6aa1e6c0943 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:52.897618 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c7beaec6-6a23-4146-ba80-f6aa1e6c0943 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:52.897784 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c7beaec6-6a23-4146-ba80-f6aa1e6c0943 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:52.898477 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c7beaec6-6a23-4146-ba80-f6aa1e6c0943 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:52.898930 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c7beaec6-6a23-4146-ba80-f6aa1e6c0943 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:52.899388 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c7beaec6-6a23-4146-ba80-f6aa1e6c0943 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:53.031622 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-c7beaec6-6a23-4146-ba80-f6aa1e6c0943 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:53.039907 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-c7beaec6-6a23-4146-ba80-f6aa1e6c0943 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:53.041497 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-c7beaec6-6a23-4146-ba80-f6aa1e6c0943 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:53.042814 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-c7beaec6-6a23-4146-ba80-f6aa1e6c0943 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1744 microversion: 2.20 time: 0.157641 Oct 17 03:56:53.050489 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 230/460] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:56:52 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:56:53.050670 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [req-ffa56422-dc8a-459d-bcdd-1273f0d742e1 req-20088d47-a21b-4143-a277-cf551f28d0e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0982f171-946d-4314-89f2-c139e6bf9adf", "name": "network-vif-plugged", "status": "completed", "tag": "8d6b4ea5-ab61-4510-be24-bef55f15afa4"}]} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:56:53.059547 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-ffa56422-dc8a-459d-bcdd-1273f0d742e1 req-20088d47-a21b-4143-a277-cf551f28d0e6 service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:53.060024 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-ffa56422-dc8a-459d-bcdd-1273f0d742e1 req-20088d47-a21b-4143-a277-cf551f28d0e6 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:53.060452 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-ffa56422-dc8a-459d-bcdd-1273f0d742e1 req-20088d47-a21b-4143-a277-cf551f28d0e6 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:53.071291 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.compute.server_external_events [req-ffa56422-dc8a-459d-bcdd-1273f0d742e1 req-20088d47-a21b-4143-a277-cf551f28d0e6 service nova] Creating event network-vif-plugged:8d6b4ea5-ab61-4510-be24-bef55f15afa4 for instance 0982f171-946d-4314-89f2-c139e6bf9adf on hv-cinder-81558 Oct 17 03:56:53.076845 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [req-ffa56422-dc8a-459d-bcdd-1273f0d742e1 req-20088d47-a21b-4143-a277-cf551f28d0e6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032319 Oct 17 03:56:53.077422 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 231/461] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 03:56:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 03:56:53.310316 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [req-1f3cc94e-1306-47b7-a97a-12a2b8ad15a3 req-d76e3274-0ada-4255-94b8-316fb9fde280 admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "6ac06077-c340-4a57-85e2-ff15f90f7662", "create_info": {"type": "qcow2", "new_file": "volume-6ac06077-c340-4a57-85e2-ff15f90f7662.ace0e160-9774-4788-abe7-42f21e6007f4.vhdx", "snapshot_id": "ace0e160-9774-4788-abe7-42f21e6007f4"}}} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:56:53.318364 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [req-1f3cc94e-1306-47b7-a97a-12a2b8ad15a3 req-d76e3274-0ada-4255-94b8-316fb9fde280 admin admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),362d8516-367c-40ac-bf4b-219a46bd8926(cell1) {{(pid=125872) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 17 03:56:53.318874 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-1f3cc94e-1306-47b7-a97a-12a2b8ad15a3 req-d76e3274-0ada-4255-94b8-316fb9fde280 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:53.319401 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-1f3cc94e-1306-47b7-a97a-12a2b8ad15a3 req-d76e3274-0ada-4255-94b8-316fb9fde280 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:53.320064 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-1f3cc94e-1306-47b7-a97a-12a2b8ad15a3 req-d76e3274-0ada-4255-94b8-316fb9fde280 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:53.360829 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-1f3cc94e-1306-47b7-a97a-12a2b8ad15a3 req-d76e3274-0ada-4255-94b8-316fb9fde280 admin admin] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:53.361312 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-1f3cc94e-1306-47b7-a97a-12a2b8ad15a3 req-d76e3274-0ada-4255-94b8-316fb9fde280 admin admin] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:53.361744 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-1f3cc94e-1306-47b7-a97a-12a2b8ad15a3 req-d76e3274-0ada-4255-94b8-316fb9fde280 admin admin] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:53.384830 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [req-1f3cc94e-1306-47b7-a97a-12a2b8ad15a3 req-d76e3274-0ada-4255-94b8-316fb9fde280 admin admin] 10.222.0.43 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.188707 Oct 17 03:56:53.385419 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 231/462] 10.222.0.43 () {64 vars in 1326 bytes} [Mon Oct 17 03:56:53 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 03:56:53.585721 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-6e1f3433-e310-408c-a9a7-eac11b951746 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:53.586452 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-6e1f3433-e310-408c-a9a7-eac11b951746 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] [instance: 35e9dd79-985d-4adf-b151-55b1db06469c] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:53.592823 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-6e1f3433-e310-408c-a9a7-eac11b951746 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:53.593308 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-6e1f3433-e310-408c-a9a7-eac11b951746 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:53.593792 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-6e1f3433-e310-408c-a9a7-eac11b951746 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:53.594481 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-6e1f3433-e310-408c-a9a7-eac11b951746 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:53.594936 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-6e1f3433-e310-408c-a9a7-eac11b951746 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:53.595393 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-6e1f3433-e310-408c-a9a7-eac11b951746 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:53.613599 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:56:53.627375 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-6e1f3433-e310-408c-a9a7-eac11b951746 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:53.627863 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-6e1f3433-e310-408c-a9a7-eac11b951746 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:53.628329 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-6e1f3433-e310-408c-a9a7-eac11b951746 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:53.628777 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.objects.instance [None req-6e1f3433-e310-408c-a9a7-eac11b951746 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lazy-loading 'fault' on Instance uuid 35e9dd79-985d-4adf-b151-55b1db06469c {{(pid=125871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:56:53.673860 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-6e1f3433-e310-408c-a9a7-eac11b951746 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a421a2a8899342b38aa61676f3b7bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7543f344fc54e41836865a828c4754d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:53.680988 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-6e1f3433-e310-408c-a9a7-eac11b951746 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] 10.222.0.16 "GET /compute/v2.1/servers/35e9dd79-985d-4adf-b151-55b1db06469c" status: 200 len: 1302 microversion: 2.1 time: 0.099593 Oct 17 03:56:53.681910 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 232/463] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:53 2022] GET /compute/v2.1/servers/35e9dd79-985d-4adf-b151-55b1db06469c => generated 1302 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:56:54.069708 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-7cd24797-8d93-464b-b43f-4a45cdc7e4d7 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:54.070419 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-7cd24797-8d93-464b-b43f-4a45cdc7e4d7 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:54.076584 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-7cd24797-8d93-464b-b43f-4a45cdc7e4d7 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:54.077070 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-7cd24797-8d93-464b-b43f-4a45cdc7e4d7 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:54.077512 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-7cd24797-8d93-464b-b43f-4a45cdc7e4d7 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:54.078204 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-7cd24797-8d93-464b-b43f-4a45cdc7e4d7 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:54.078662 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-7cd24797-8d93-464b-b43f-4a45cdc7e4d7 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:54.079089 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-7cd24797-8d93-464b-b43f-4a45cdc7e4d7 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:54.208145 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-7cd24797-8d93-464b-b43f-4a45cdc7e4d7 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:54.216952 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-7cd24797-8d93-464b-b43f-4a45cdc7e4d7 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:54.218414 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-7cd24797-8d93-464b-b43f-4a45cdc7e4d7 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:54.219605 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-7cd24797-8d93-464b-b43f-4a45cdc7e4d7 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1744 microversion: 2.20 time: 0.154717 Oct 17 03:56:54.220317 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 232/464] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:56:54 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:56:54.704606 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-54c9aedc-8720-47da-93a1-53f2be81c727 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:54.705210 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-54c9aedc-8720-47da-93a1-53f2be81c727 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] [instance: 35e9dd79-985d-4adf-b151-55b1db06469c] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:54.712216 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-54c9aedc-8720-47da-93a1-53f2be81c727 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:54.712694 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-54c9aedc-8720-47da-93a1-53f2be81c727 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:54.713124 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-54c9aedc-8720-47da-93a1-53f2be81c727 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:54.713806 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-54c9aedc-8720-47da-93a1-53f2be81c727 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:54.714898 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-54c9aedc-8720-47da-93a1-53f2be81c727 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:54.715349 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-54c9aedc-8720-47da-93a1-53f2be81c727 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:54.730300 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.wsgi [None req-54c9aedc-8720-47da-93a1-53f2be81c727 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] HTTP exception thrown: Instance 35e9dd79-985d-4adf-b151-55b1db06469c could not be found. Oct 17 03:56:54.732002 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-54c9aedc-8720-47da-93a1-53f2be81c727 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Request method failure captured: Oct 17 03:56:54.732002 dv-cinder-815582-16-smb devstack@n-api.service[125871]: request: GET /compute/v2.1/servers/35e9dd79-985d-4adf-b151-55b1db06469c HTTP/1.1 Oct 17 03:56:54.732002 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Accept: application/json Oct 17 03:56:54.732002 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Accept-Encoding: identity Oct 17 03:56:54.732002 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Connection: close Oct 17 03:56:54.732002 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Content-Length: 0 Oct 17 03:56:54.732002 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Content-Type: application/json Oct 17 03:56:54.732002 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Host: 10.222.0.16 Oct 17 03:56:54.732002 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Openstack-System-Scope: None Oct 17 03:56:54.732002 dv-cinder-815582-16-smb devstack@n-api.service[125871]: User-Agent: python-urllib3/1.26.12 Oct 17 03:56:54.732002 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Auth-Token: gAAAAABjTNJTWkXo3aMqRBdA_Wz8GxFT38oJ36pL7cIqVg8rl0ZDefIlNzHYhK4rSkV2dAum6tCAluOwkYOJ2bQGUaEusM-bhBdlduqq83N08_CCFciIZ9dEGej8EO-UmZVvb-0MFCLIT2mO6DrniQVN7KAMdKMJy7HyH-caQ9X3TrRgD1f2QjE Oct 17 03:56:54.732002 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Domain-Id: None Oct 17 03:56:54.732002 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Domain-Name: None Oct 17 03:56:54.732002 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Identity-Status: Confirmed Oct 17 03:56:54.732002 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Is-Admin-Project: True Oct 17 03:56:54.732002 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Domain-Id: default Oct 17 03:56:54.732002 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Domain-Name: Default Oct 17 03:56:54.732002 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Id: b7543f344fc54e41836865a828c4754d Oct 17 03:56:54.732002 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Name: tempest-VolumesActionsTest-135237744 Oct 17 03:56:54.732002 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Role: reader,member Oct 17 03:56:54.732002 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Roles: reader,member Oct 17 03:56:54.733358 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b7543f344fc54e41836865a828c4754d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b7543f344fc54e41836865a828c4754d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b7543f344fc54e41836865a828c4754d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b7543f344fc54e41836865a828c4754d", "adminURL": "http://10.222.0.16:8080"}]}] Oct 17 03:56:54.733358 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant: tempest-VolumesActionsTest-135237744 Oct 17 03:56:54.733358 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant-Id: b7543f344fc54e41836865a828c4754d Oct 17 03:56:54.733358 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant-Name: tempest-VolumesActionsTest-135237744 Oct 17 03:56:54.733358 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User: tempest-VolumesActionsTest-135237744-project Oct 17 03:56:54.733358 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Domain-Id: default Oct 17 03:56:54.733358 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Domain-Name: Default Oct 17 03:56:54.733358 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Id: a421a2a8899342b38aa61676f3b7bc01 Oct 17 03:56:54.733358 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Name: tempest-VolumesActionsTest-135237744-project Oct 17 03:56:54.733358 dv-cinder-815582-16-smb devstack@n-api.service[125871]: method: > Oct 17 03:56:54.733358 dv-cinder-815582-16-smb devstack@n-api.service[125871]: exception: Instance 35e9dd79-985d-4adf-b151-55b1db06469c could not be found. Oct 17 03:56:54.733358 dv-cinder-815582-16-smb devstack@n-api.service[125871]: action_args: {'id': '35e9dd79-985d-4adf-b151-55b1db06469c'} Oct 17 03:56:54.734076 dv-cinder-815582-16-smb devstack@n-api.service[125871]: {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:56:54.734076 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:56:54.734076 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 03:56:54.734076 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 03:56:54.734076 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 03:56:54.734076 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 03:56:54.734076 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 03:56:54.734076 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 03:56:54.734076 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 03:56:54.734076 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 03:56:54.734076 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35e9dd79-985d-4adf-b151-55b1db06469c could not be found. Oct 17 03:56:54.734076 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:56:54.734076 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:56:54.734076 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:56:54.734076 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:56:54.734076 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:56:54.734076 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:56:54.734076 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:56:54.734076 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:56:54.734076 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:56:54.735430 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:56:54.735430 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 03:56:54.735430 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 03:56:54.735430 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 03:56:54.735430 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 03:56:54.735430 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 03:56:54.735430 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:56:54.735430 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35e9dd79-985d-4adf-b151-55b1db06469c could not be found. Oct 17 03:56:54.735430 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:56:54.735430 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:56:54.735430 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:56:54.735430 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:56:54.735430 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:56:54.735430 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:56:54.735430 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:56:54.735430 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:56:54.735430 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35e9dd79-985d-4adf-b151-55b1db06469c could not be found. Oct 17 03:56:54.735430 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:56:54.736493 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-54c9aedc-8720-47da-93a1-53f2be81c727 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] Returning 404 to user: Instance 35e9dd79-985d-4adf-b151-55b1db06469c could not be found. {{(pid=125871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:56:54.736493 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-54c9aedc-8720-47da-93a1-53f2be81c727 tempest-VolumesActionsTest-135237744 tempest-VolumesActionsTest-135237744-project] 10.222.0.16 "GET /compute/v2.1/servers/35e9dd79-985d-4adf-b151-55b1db06469c" status: 404 len: 111 microversion: 2.1 time: 0.032637 Oct 17 03:56:54.736493 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 233/465] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:54 2022] GET /compute/v2.1/servers/35e9dd79-985d-4adf-b151-55b1db06469c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 03:56:55.245890 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-9c9a43da-e2e0-4292-ae14-9fbba525158d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:55.246506 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-9c9a43da-e2e0-4292-ae14-9fbba525158d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:55.253956 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-9c9a43da-e2e0-4292-ae14-9fbba525158d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:55.254437 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-9c9a43da-e2e0-4292-ae14-9fbba525158d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:55.255208 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-9c9a43da-e2e0-4292-ae14-9fbba525158d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:55.255587 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-9c9a43da-e2e0-4292-ae14-9fbba525158d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:55.256169 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-9c9a43da-e2e0-4292-ae14-9fbba525158d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:55.256437 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-9c9a43da-e2e0-4292-ae14-9fbba525158d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:55.385919 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-9c9a43da-e2e0-4292-ae14-9fbba525158d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:55.395071 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-9c9a43da-e2e0-4292-ae14-9fbba525158d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:55.396676 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-9c9a43da-e2e0-4292-ae14-9fbba525158d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:55.397824 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-9c9a43da-e2e0-4292-ae14-9fbba525158d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1739 microversion: 2.20 time: 0.155888 Oct 17 03:56:55.398380 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 233/466] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:56:55 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1739 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:56:56.426027 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-b978f7d6-d3cf-43ca-b0be-02b5dad2ca5d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:56.426639 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-b978f7d6-d3cf-43ca-b0be-02b5dad2ca5d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:56.433649 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b978f7d6-d3cf-43ca-b0be-02b5dad2ca5d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:56.434131 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b978f7d6-d3cf-43ca-b0be-02b5dad2ca5d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:56.434565 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b978f7d6-d3cf-43ca-b0be-02b5dad2ca5d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:56.435282 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b978f7d6-d3cf-43ca-b0be-02b5dad2ca5d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:56.435738 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b978f7d6-d3cf-43ca-b0be-02b5dad2ca5d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:56.436164 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b978f7d6-d3cf-43ca-b0be-02b5dad2ca5d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:56.583758 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-b978f7d6-d3cf-43ca-b0be-02b5dad2ca5d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:56.593747 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-b978f7d6-d3cf-43ca-b0be-02b5dad2ca5d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:56.596606 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-b978f7d6-d3cf-43ca-b0be-02b5dad2ca5d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:56.596606 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-b978f7d6-d3cf-43ca-b0be-02b5dad2ca5d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1739 microversion: 2.20 time: 0.174634 Oct 17 03:56:56.597071 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 234/467] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:56:56 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1739 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:56:57.623101 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-8212861b-4e19-4119-ad37-d814568f98b3 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:57.624009 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-8212861b-4e19-4119-ad37-d814568f98b3 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:57.642573 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8212861b-4e19-4119-ad37-d814568f98b3 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:57.643072 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8212861b-4e19-4119-ad37-d814568f98b3 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:57.645178 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8212861b-4e19-4119-ad37-d814568f98b3 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:57.646159 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8212861b-4e19-4119-ad37-d814568f98b3 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:57.649283 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8212861b-4e19-4119-ad37-d814568f98b3 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:57.649890 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8212861b-4e19-4119-ad37-d814568f98b3 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:57.879448 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-8212861b-4e19-4119-ad37-d814568f98b3 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:57.891478 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-8212861b-4e19-4119-ad37-d814568f98b3 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:57.893476 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-8212861b-4e19-4119-ad37-d814568f98b3 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:57.894844 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-8212861b-4e19-4119-ad37-d814568f98b3 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1739 microversion: 2.20 time: 0.276479 Oct 17 03:56:57.908359 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 234/468] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:56:57 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1739 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:56:58.460916 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-e45d1e65-ad7c-4e05-9e78-6cf0a14f7762 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:58.462220 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-e45d1e65-ad7c-4e05-9e78-6cf0a14f7762 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 44d8e487-b994-45ac-b2e4-47a6b7d425fe] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:58.473795 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e45d1e65-ad7c-4e05-9e78-6cf0a14f7762 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:58.474699 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e45d1e65-ad7c-4e05-9e78-6cf0a14f7762 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:58.475394 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e45d1e65-ad7c-4e05-9e78-6cf0a14f7762 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:58.476352 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e45d1e65-ad7c-4e05-9e78-6cf0a14f7762 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:58.477045 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e45d1e65-ad7c-4e05-9e78-6cf0a14f7762 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:58.477713 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e45d1e65-ad7c-4e05-9e78-6cf0a14f7762 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:58.519436 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-e45d1e65-ad7c-4e05-9e78-6cf0a14f7762 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/44d8e487-b994-45ac-b2e4-47a6b7d425fe/ips" status: 200 len: 151 microversion: 2.1 time: 0.062890 Oct 17 03:56:58.529358 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 235/469] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Oct 17 03:56:58 2022] GET /compute/v2.1/servers/44d8e487-b994-45ac-b2e4-47a6b7d425fe/ips => generated 151 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:56:58.536559 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-937c2c30-02e1-4507-8431-6b1610a3fd72 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b4dfc0cd-7015-4b84-b8f9-f29eef843f13"}} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:56:58.540813 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-937c2c30-02e1-4507-8431-6b1610a3fd72 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 44d8e487-b994-45ac-b2e4-47a6b7d425fe] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:58.565535 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-937c2c30-02e1-4507-8431-6b1610a3fd72 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:58.567380 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-937c2c30-02e1-4507-8431-6b1610a3fd72 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:58.568650 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-937c2c30-02e1-4507-8431-6b1610a3fd72 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:58.571924 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-937c2c30-02e1-4507-8431-6b1610a3fd72 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:58.573098 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-937c2c30-02e1-4507-8431-6b1610a3fd72 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:58.576471 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-937c2c30-02e1-4507-8431-6b1610a3fd72 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:58.786645 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_cell1:SELECT=100 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:56:58.793587 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.wsgi [None req-937c2c30-02e1-4507-8431-6b1610a3fd72 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] HTTP exception thrown: Invalid volume: volume b4dfc0cd-7015-4b84-b8f9-f29eef843f13 is already attached to instances: ff49fd54-9ddf-415d-8eb4-fb1b0bef634c Oct 17 03:56:58.801482 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-937c2c30-02e1-4507-8431-6b1610a3fd72 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Request method failure captured: Oct 17 03:56:58.801482 dv-cinder-815582-16-smb devstack@n-api.service[125872]: request: POST /compute/v2.1/servers/44d8e487-b994-45ac-b2e4-47a6b7d425fe/os-volume_attachments HTTP/1.1 Oct 17 03:56:58.801482 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Accept: application/json Oct 17 03:56:58.801482 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Accept-Encoding: identity Oct 17 03:56:58.801482 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Connection: close Oct 17 03:56:58.801482 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Content-Length: 74 Oct 17 03:56:58.801482 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Content-Type: application/json Oct 17 03:56:58.801482 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Host: 10.222.0.16 Oct 17 03:56:58.801482 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Openstack-System-Scope: None Oct 17 03:56:58.801482 dv-cinder-815582-16-smb devstack@n-api.service[125872]: User-Agent: python-urllib3/1.26.12 Oct 17 03:56:58.801482 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Auth-Token: gAAAAABjTNHS-JkBpYGlE8smCEkK5jojHou0K6VK_tNmdNYF8mJS0isG5A2O-CJO1Z0ixcowhaVCDpWbdKHf1nvQBjXwKqEHeDqSudyXAc3IKeNiaKgebnu28MS5PTi1Pi3TKRwLiMEjkJOln2AC5NFbphJ0QfPkQ085FD6azHU6IqdftqedhcI Oct 17 03:56:58.801482 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Domain-Id: None Oct 17 03:56:58.801482 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Domain-Name: None Oct 17 03:56:58.801482 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Identity-Status: Confirmed Oct 17 03:56:58.801482 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Is-Admin-Project: True Oct 17 03:56:58.801482 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Domain-Id: default Oct 17 03:56:58.801482 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Domain-Name: Default Oct 17 03:56:58.801482 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Id: 8af3ce80f169473882a247ba78d3d6ef Oct 17 03:56:58.801482 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Name: tempest-AttachVolumeNegativeTest-973579303 Oct 17 03:56:58.801482 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Role: reader,member Oct 17 03:56:58.801482 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Roles: reader,member Oct 17 03:56:58.803142 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8af3ce80f169473882a247ba78d3d6ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8af3ce80f169473882a247ba78d3d6ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8af3ce80f169473882a247ba78d3d6ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8af3ce80f169473882a247ba78d3d6ef", "adminURL": "http://10.222.0.16:8080"}]}] Oct 17 03:56:58.803142 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant: tempest-AttachVolumeNegativeTest-973579303 Oct 17 03:56:58.803142 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant-Id: 8af3ce80f169473882a247ba78d3d6ef Oct 17 03:56:58.803142 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-973579303 Oct 17 03:56:58.803142 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User: tempest-AttachVolumeNegativeTest-973579303-project Oct 17 03:56:58.803142 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Domain-Id: default Oct 17 03:56:58.803142 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Domain-Name: Default Oct 17 03:56:58.803142 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Id: e9ac14bb6ceb4d9a92a20938e9688bbd Oct 17 03:56:58.803142 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Name: tempest-AttachVolumeNegativeTest-973579303-project Oct 17 03:56:58.803142 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Oct 17 03:56:58.803142 dv-cinder-815582-16-smb devstack@n-api.service[125872]: {"volumeAttachment": {"volumeId": "b4dfc0cd-7015-4b84-b8f9-f29eef843f13"}} Oct 17 03:56:58.803142 dv-cinder-815582-16-smb devstack@n-api.service[125872]: method: > Oct 17 03:56:58.804183 dv-cinder-815582-16-smb devstack@n-api.service[125872]: exception: Invalid volume: volume b4dfc0cd-7015-4b84-b8f9-f29eef843f13 is already attached to instances: ff49fd54-9ddf-415d-8eb4-fb1b0bef634c Oct 17 03:56:58.804183 dv-cinder-815582-16-smb devstack@n-api.service[125872]: action_args: {'server_id': '44d8e487-b994-45ac-b2e4-47a6b7d425fe', 'body': {'volumeAttachment': {'volumeId': 'b4dfc0cd-7015-4b84-b8f9-f29eef843f13'}}} Oct 17 03:56:58.804183 dv-cinder-815582-16-smb devstack@n-api.service[125872]: {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:56:58.804183 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:56:58.804183 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 17 03:56:58.804183 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 17 03:56:58.804183 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 03:56:58.804183 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 03:56:58.804183 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 17 03:56:58.804183 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 03:56:58.804183 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 17 03:56:58.804183 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 17 03:56:58.804183 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 17 03:56:58.804183 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 17 03:56:58.804183 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b4dfc0cd-7015-4b84-b8f9-f29eef843f13 is already attached to instances: ff49fd54-9ddf-415d-8eb4-fb1b0bef634c Oct 17 03:56:58.804183 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:56:58.804183 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:56:58.804183 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:56:58.804183 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:56:58.805709 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:56:58.805709 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:56:58.805709 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:56:58.805709 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:56:58.805709 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:56:58.805709 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:56:58.805709 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 03:56:58.805709 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 03:56:58.805709 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 03:56:58.805709 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 03:56:58.805709 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 03:56:58.805709 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 03:56:58.805709 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 17 03:56:58.805709 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 17 03:56:58.805709 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b4dfc0cd-7015-4b84-b8f9-f29eef843f13 is already attached to instances: ff49fd54-9ddf-415d-8eb4-fb1b0bef634c Oct 17 03:56:58.805709 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:56:58.805709 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:56:58.805709 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:56:58.805709 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:56:58.805709 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:56:58.807326 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:56:58.807326 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:56:58.807326 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:56:58.807326 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b4dfc0cd-7015-4b84-b8f9-f29eef843f13 is already attached to instances: ff49fd54-9ddf-415d-8eb4-fb1b0bef634c Oct 17 03:56:58.807326 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:56:58.807326 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-937c2c30-02e1-4507-8431-6b1610a3fd72 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Returning 400 to user: Invalid volume: volume b4dfc0cd-7015-4b84-b8f9-f29eef843f13 is already attached to instances: ff49fd54-9ddf-415d-8eb4-fb1b0bef634c {{(pid=125872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:56:58.812679 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-937c2c30-02e1-4507-8431-6b1610a3fd72 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "POST /compute/v2.1/servers/44d8e487-b994-45ac-b2e4-47a6b7d425fe/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.280499 Oct 17 03:56:58.817636 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 235/470] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Oct 17 03:56:58 2022] POST /compute/v2.1/servers/44d8e487-b994-45ac-b2e4-47a6b7d425fe/os-volume_attachments => generated 174 bytes in 290 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 03:56:58.825997 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-021dd5a8-0976-4e06-8ce0-6cd10f96fc92 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:58.829669 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-021dd5a8-0976-4e06-8ce0-6cd10f96fc92 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 44d8e487-b994-45ac-b2e4-47a6b7d425fe] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:58.847597 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-021dd5a8-0976-4e06-8ce0-6cd10f96fc92 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:58.848343 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-021dd5a8-0976-4e06-8ce0-6cd10f96fc92 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:58.850032 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-021dd5a8-0976-4e06-8ce0-6cd10f96fc92 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:58.851120 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-021dd5a8-0976-4e06-8ce0-6cd10f96fc92 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:58.851755 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-021dd5a8-0976-4e06-8ce0-6cd10f96fc92 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:58.852466 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-021dd5a8-0976-4e06-8ce0-6cd10f96fc92 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:58.878612 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [req-75cb5a18-c797-45fa-b695-a35f84b7f5b7 req-6b9cc199-5606-4852-a712-5dcd1ae6ccff admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "6ac06077-c340-4a57-85e2-ff15f90f7662", "create_info": {"type": "qcow2", "new_file": "volume-6ac06077-c340-4a57-85e2-ff15f90f7662.c6127db3-7ac0-45df-9605-b41269986bf8.vhdx", "snapshot_id": "c6127db3-7ac0-45df-9605-b41269986bf8"}}} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:56:58.889532 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-021dd5a8-0976-4e06-8ce0-6cd10f96fc92 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 44d8e487-b994-45ac-b2e4-47a6b7d425fe] Going to try to terminate instance {{(pid=125872) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 03:56:58.893036 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [req-75cb5a18-c797-45fa-b695-a35f84b7f5b7 req-6b9cc199-5606-4852-a712-5dcd1ae6ccff admin admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),362d8516-367c-40ac-bf4b-219a46bd8926(cell1) {{(pid=125871) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 17 03:56:58.893772 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-75cb5a18-c797-45fa-b695-a35f84b7f5b7 req-6b9cc199-5606-4852-a712-5dcd1ae6ccff admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:58.894426 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-75cb5a18-c797-45fa-b695-a35f84b7f5b7 req-6b9cc199-5606-4852-a712-5dcd1ae6ccff admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:58.895117 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-75cb5a18-c797-45fa-b695-a35f84b7f5b7 req-6b9cc199-5606-4852-a712-5dcd1ae6ccff admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:59.046255 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-75cb5a18-c797-45fa-b695-a35f84b7f5b7 req-6b9cc199-5606-4852-a712-5dcd1ae6ccff admin admin] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:59.046851 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-75cb5a18-c797-45fa-b695-a35f84b7f5b7 req-6b9cc199-5606-4852-a712-5dcd1ae6ccff admin admin] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:59.047319 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-75cb5a18-c797-45fa-b695-a35f84b7f5b7 req-6b9cc199-5606-4852-a712-5dcd1ae6ccff admin admin] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:59.129525 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [req-75cb5a18-c797-45fa-b695-a35f84b7f5b7 req-6b9cc199-5606-4852-a712-5dcd1ae6ccff admin admin] 10.222.0.43 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.414002 Oct 17 03:56:59.138636 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 236/471] 10.222.0.43 () {64 vars in 1326 bytes} [Mon Oct 17 03:56:58 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 17 03:56:59.165291 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-87d6e7fe-7997-48ad-935f-4df2d27c007a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:59.167328 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-87d6e7fe-7997-48ad-935f-4df2d27c007a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:59.177347 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-87d6e7fe-7997-48ad-935f-4df2d27c007a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:59.179631 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-87d6e7fe-7997-48ad-935f-4df2d27c007a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:59.183569 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-87d6e7fe-7997-48ad-935f-4df2d27c007a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:59.183569 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-87d6e7fe-7997-48ad-935f-4df2d27c007a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:59.185655 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-87d6e7fe-7997-48ad-935f-4df2d27c007a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:59.186773 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-87d6e7fe-7997-48ad-935f-4df2d27c007a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:59.336336 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-021dd5a8-0976-4e06-8ce0-6cd10f96fc92 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "DELETE /compute/v2.1/servers/44d8e487-b994-45ac-b2e4-47a6b7d425fe" status: 204 len: 0 microversion: 2.1 time: 0.515912 Oct 17 03:56:59.340777 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 236/472] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 17 03:56:58 2022] DELETE /compute/v2.1/servers/44d8e487-b994-45ac-b2e4-47a6b7d425fe => generated 0 bytes in 519 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 03:56:59.347155 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-0e569519-b03e-4a6e-a526-af98d568b447 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:56:59.347879 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-0e569519-b03e-4a6e-a526-af98d568b447 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 44d8e487-b994-45ac-b2e4-47a6b7d425fe] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:56:59.367131 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0e569519-b03e-4a6e-a526-af98d568b447 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:59.372496 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0e569519-b03e-4a6e-a526-af98d568b447 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:59.372496 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0e569519-b03e-4a6e-a526-af98d568b447 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:59.372496 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0e569519-b03e-4a6e-a526-af98d568b447 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:56:59.372496 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0e569519-b03e-4a6e-a526-af98d568b447 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:56:59.372997 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0e569519-b03e-4a6e-a526-af98d568b447 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:56:59.475450 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-87d6e7fe-7997-48ad-935f-4df2d27c007a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:59.480347 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-87d6e7fe-7997-48ad-935f-4df2d27c007a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:59.490852 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-87d6e7fe-7997-48ad-935f-4df2d27c007a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:59.492523 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-87d6e7fe-7997-48ad-935f-4df2d27c007a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1739 microversion: 2.20 time: 0.350416 Oct 17 03:56:59.493872 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 237/473] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:56:59 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1739 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:56:59.665870 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-0e569519-b03e-4a6e-a526-af98d568b447 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:56:59.677331 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-0e569519-b03e-4a6e-a526-af98d568b447 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/44d8e487-b994-45ac-b2e4-47a6b7d425fe" status: 200 len: 1683 microversion: 2.1 time: 0.333628 Oct 17 03:56:59.678593 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 237/474] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:56:59 2022] GET /compute/v2.1/servers/44d8e487-b994-45ac-b2e4-47a6b7d425fe => generated 1683 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:00.524844 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-29701ecc-b433-4ae5-8201-e62d57a7366a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:00.525452 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-29701ecc-b433-4ae5-8201-e62d57a7366a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:00.533299 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-29701ecc-b433-4ae5-8201-e62d57a7366a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:00.534071 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-29701ecc-b433-4ae5-8201-e62d57a7366a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:00.534510 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-29701ecc-b433-4ae5-8201-e62d57a7366a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:00.535599 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-29701ecc-b433-4ae5-8201-e62d57a7366a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:00.536346 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-29701ecc-b433-4ae5-8201-e62d57a7366a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:00.537078 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-29701ecc-b433-4ae5-8201-e62d57a7366a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:00.704046 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-c9478dd1-b69c-4051-a566-68ebb7aa4f27 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:00.706093 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-c9478dd1-b69c-4051-a566-68ebb7aa4f27 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 44d8e487-b994-45ac-b2e4-47a6b7d425fe] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:00.726911 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c9478dd1-b69c-4051-a566-68ebb7aa4f27 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:00.727899 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c9478dd1-b69c-4051-a566-68ebb7aa4f27 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:00.728592 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c9478dd1-b69c-4051-a566-68ebb7aa4f27 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:00.729622 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c9478dd1-b69c-4051-a566-68ebb7aa4f27 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:00.730313 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c9478dd1-b69c-4051-a566-68ebb7aa4f27 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:00.731615 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c9478dd1-b69c-4051-a566-68ebb7aa4f27 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:00.756290 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-29701ecc-b433-4ae5-8201-e62d57a7366a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:00.766458 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-29701ecc-b433-4ae5-8201-e62d57a7366a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:00.767999 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-29701ecc-b433-4ae5-8201-e62d57a7366a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:00.769183 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-29701ecc-b433-4ae5-8201-e62d57a7366a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1739 microversion: 2.20 time: 0.248362 Oct 17 03:57:00.769744 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 238/475] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:57:00 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1739 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:57:00.965907 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-c9478dd1-b69c-4051-a566-68ebb7aa4f27 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:00.975965 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-c9478dd1-b69c-4051-a566-68ebb7aa4f27 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/44d8e487-b994-45ac-b2e4-47a6b7d425fe" status: 200 len: 1683 microversion: 2.1 time: 0.277780 Oct 17 03:57:00.979091 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 238/476] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:00 2022] GET /compute/v2.1/servers/44d8e487-b994-45ac-b2e4-47a6b7d425fe => generated 1683 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:01.800478 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-6ed872ba-c504-4f10-aa61-84694fcaa224 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:01.801257 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-6ed872ba-c504-4f10-aa61-84694fcaa224 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:01.809181 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-6ed872ba-c504-4f10-aa61-84694fcaa224 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:01.810005 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-6ed872ba-c504-4f10-aa61-84694fcaa224 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:01.810539 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-6ed872ba-c504-4f10-aa61-84694fcaa224 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:01.811412 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-6ed872ba-c504-4f10-aa61-84694fcaa224 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:01.811993 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-6ed872ba-c504-4f10-aa61-84694fcaa224 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:01.812519 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-6ed872ba-c504-4f10-aa61-84694fcaa224 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:02.001857 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-6e2c89a1-6c8a-4d6b-ae80-820b6656b3d2 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:02.002450 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-6e2c89a1-6c8a-4d6b-ae80-820b6656b3d2 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 44d8e487-b994-45ac-b2e4-47a6b7d425fe] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:02.016552 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=84,nova_api:UPDATE=1 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:57:02.018019 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6e2c89a1-6c8a-4d6b-ae80-820b6656b3d2 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:02.019167 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6e2c89a1-6c8a-4d6b-ae80-820b6656b3d2 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:02.019793 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6e2c89a1-6c8a-4d6b-ae80-820b6656b3d2 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:02.020518 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6e2c89a1-6c8a-4d6b-ae80-820b6656b3d2 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:02.020979 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6e2c89a1-6c8a-4d6b-ae80-820b6656b3d2 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:02.021405 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6e2c89a1-6c8a-4d6b-ae80-820b6656b3d2 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:02.031737 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-6ed872ba-c504-4f10-aa61-84694fcaa224 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:02.043159 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-6ed872ba-c504-4f10-aa61-84694fcaa224 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:02.045098 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-6ed872ba-c504-4f10-aa61-84694fcaa224 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:02.046406 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-6ed872ba-c504-4f10-aa61-84694fcaa224 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1739 microversion: 2.20 time: 0.250608 Oct 17 03:57:02.059212 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 239/477] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:57:01 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1739 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:57:02.273121 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-6e2c89a1-6c8a-4d6b-ae80-820b6656b3d2 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:02.288019 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-6e2c89a1-6c8a-4d6b-ae80-820b6656b3d2 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/44d8e487-b994-45ac-b2e4-47a6b7d425fe" status: 200 len: 1683 microversion: 2.1 time: 0.285235 Oct 17 03:57:02.300622 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 239/478] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:01 2022] GET /compute/v2.1/servers/44d8e487-b994-45ac-b2e4-47a6b7d425fe => generated 1683 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:03.072789 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-69c8b452-11e9-46e8-978b-6b9e4f83c76e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:03.074241 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-69c8b452-11e9-46e8-978b-6b9e4f83c76e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:03.087363 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-69c8b452-11e9-46e8-978b-6b9e4f83c76e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:03.095382 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-69c8b452-11e9-46e8-978b-6b9e4f83c76e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:03.095382 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-69c8b452-11e9-46e8-978b-6b9e4f83c76e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:03.095382 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-69c8b452-11e9-46e8-978b-6b9e4f83c76e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:03.095382 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-69c8b452-11e9-46e8-978b-6b9e4f83c76e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:03.095749 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-69c8b452-11e9-46e8-978b-6b9e4f83c76e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:03.316602 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-ca82d64c-a04d-4e4f-b0b8-635a94ece116 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:03.318135 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-ca82d64c-a04d-4e4f-b0b8-635a94ece116 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 44d8e487-b994-45ac-b2e4-47a6b7d425fe] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:03.328371 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ca82d64c-a04d-4e4f-b0b8-635a94ece116 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:03.329234 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ca82d64c-a04d-4e4f-b0b8-635a94ece116 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:03.330206 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ca82d64c-a04d-4e4f-b0b8-635a94ece116 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:03.331486 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ca82d64c-a04d-4e4f-b0b8-635a94ece116 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:03.332875 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ca82d64c-a04d-4e4f-b0b8-635a94ece116 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:03.333712 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ca82d64c-a04d-4e4f-b0b8-635a94ece116 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:03.380357 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_cell0:SELECT=2 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:57:03.549458 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-ca82d64c-a04d-4e4f-b0b8-635a94ece116 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:03.561123 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-ca82d64c-a04d-4e4f-b0b8-635a94ece116 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/44d8e487-b994-45ac-b2e4-47a6b7d425fe" status: 200 len: 1683 microversion: 2.1 time: 0.248440 Oct 17 03:57:03.572945 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 240/479] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:03 2022] GET /compute/v2.1/servers/44d8e487-b994-45ac-b2e4-47a6b7d425fe => generated 1683 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:03.685916 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-69c8b452-11e9-46e8-978b-6b9e4f83c76e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:03.697943 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-69c8b452-11e9-46e8-978b-6b9e4f83c76e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:03.700065 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-69c8b452-11e9-46e8-978b-6b9e4f83c76e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:03.701264 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-69c8b452-11e9-46e8-978b-6b9e4f83c76e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1739 microversion: 2.20 time: 0.632468 Oct 17 03:57:03.702028 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 240/480] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:57:03 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1739 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:57:04.427272 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-81274858-b51b-4d9b-9fec-7873b183b9d5 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:04.427847 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-81274858-b51b-4d9b-9fec-7873b183b9d5 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:04.453252 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-81274858-b51b-4d9b-9fec-7873b183b9d5 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:04.453759 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-81274858-b51b-4d9b-9fec-7873b183b9d5 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:04.454203 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-81274858-b51b-4d9b-9fec-7873b183b9d5 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:04.455902 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-81274858-b51b-4d9b-9fec-7873b183b9d5 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:04.455902 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-81274858-b51b-4d9b-9fec-7873b183b9d5 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:04.473467 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-81274858-b51b-4d9b-9fec-7873b183b9d5 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:04.587425 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-0eaea722-eb6b-412a-8932-9cbee5390f5d tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:04.590922 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-0eaea722-eb6b-412a-8932-9cbee5390f5d tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 44d8e487-b994-45ac-b2e4-47a6b7d425fe] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:04.612627 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0eaea722-eb6b-412a-8932-9cbee5390f5d tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:04.621780 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0eaea722-eb6b-412a-8932-9cbee5390f5d tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:04.622269 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0eaea722-eb6b-412a-8932-9cbee5390f5d tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:04.627065 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0eaea722-eb6b-412a-8932-9cbee5390f5d tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:04.627630 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0eaea722-eb6b-412a-8932-9cbee5390f5d tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:04.628080 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0eaea722-eb6b-412a-8932-9cbee5390f5d tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:04.878090 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.objects.instance [None req-81274858-b51b-4d9b-9fec-7873b183b9d5 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lazy-loading 'services' on Instance uuid bf50abcd-84fd-4541-b899-b6f5dad606fe {{(pid=125872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:57:04.909872 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-0eaea722-eb6b-412a-8932-9cbee5390f5d tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:04.921792 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-0eaea722-eb6b-412a-8932-9cbee5390f5d tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/44d8e487-b994-45ac-b2e4-47a6b7d425fe" status: 200 len: 1616 microversion: 2.1 time: 0.338313 Oct 17 03:57:04.922376 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 241/481] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:04 2022] GET /compute/v2.1/servers/44d8e487-b994-45ac-b2e4-47a6b7d425fe => generated 1616 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:04.956372 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [req-05be7fb2-8196-4def-8f6d-c8a235cfdac7 req-4c6699f3-e26b-481a-9556-7185bd87f20d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44d8e487-b994-45ac-b2e4-47a6b7d425fe", "name": "network-vif-deleted", "tag": "29b0d627-a2ca-49fa-8220-6e478eea9d13"}]} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:57:04.996584 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-05be7fb2-8196-4def-8f6d-c8a235cfdac7 req-4c6699f3-e26b-481a-9556-7185bd87f20d service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:04.998053 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-05be7fb2-8196-4def-8f6d-c8a235cfdac7 req-4c6699f3-e26b-481a-9556-7185bd87f20d service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:04.999939 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-05be7fb2-8196-4def-8f6d-c8a235cfdac7 req-4c6699f3-e26b-481a-9556-7185bd87f20d service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:05.042472 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.compute.server_external_events [req-05be7fb2-8196-4def-8f6d-c8a235cfdac7 req-4c6699f3-e26b-481a-9556-7185bd87f20d service nova] Creating event network-vif-deleted:29b0d627-a2ca-49fa-8220-6e478eea9d13 for instance 44d8e487-b994-45ac-b2e4-47a6b7d425fe on hv-cinder-81558 Oct 17 03:57:05.049453 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [req-05be7fb2-8196-4def-8f6d-c8a235cfdac7 req-4c6699f3-e26b-481a-9556-7185bd87f20d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125892 Oct 17 03:57:05.050621 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 242/482] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 03:57:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:57:05.066098 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-321e6ffd-a20f-4418-b20a-b4e0c8be92cc tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:05.067050 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-321e6ffd-a20f-4418-b20a-b4e0c8be92cc tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:05.074364 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-321e6ffd-a20f-4418-b20a-b4e0c8be92cc tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:05.074863 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-321e6ffd-a20f-4418-b20a-b4e0c8be92cc tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:05.075348 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-321e6ffd-a20f-4418-b20a-b4e0c8be92cc tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:05.076060 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-321e6ffd-a20f-4418-b20a-b4e0c8be92cc tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:05.076522 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-321e6ffd-a20f-4418-b20a-b4e0c8be92cc tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:05.076951 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-321e6ffd-a20f-4418-b20a-b4e0c8be92cc tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:05.376481 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-81274858-b51b-4d9b-9fec-7873b183b9d5 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe/os-volume_attachments/ce179add-8f5d-436e-b71f-6954b0ece0e4" status: 202 len: 0 microversion: 2.1 time: 0.954572 Oct 17 03:57:05.379329 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 241/483] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Oct 17 03:57:04 2022] DELETE /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe/os-volume_attachments/ce179add-8f5d-436e-b71f-6954b0ece0e4 => generated 0 bytes in 956 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 03:57:05.451823 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-321e6ffd-a20f-4418-b20a-b4e0c8be92cc tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:05.464154 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-321e6ffd-a20f-4418-b20a-b4e0c8be92cc tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:05.471485 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-321e6ffd-a20f-4418-b20a-b4e0c8be92cc tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:05.480752 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-321e6ffd-a20f-4418-b20a-b4e0c8be92cc tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1739 microversion: 2.20 time: 0.421303 Oct 17 03:57:05.480752 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 243/484] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:57:05 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1739 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:57:05.950549 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-d2f1db76-6994-43cf-8c9c-2ca03d0161d7 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:05.952060 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-d2f1db76-6994-43cf-8c9c-2ca03d0161d7 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 44d8e487-b994-45ac-b2e4-47a6b7d425fe] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:05.963118 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d2f1db76-6994-43cf-8c9c-2ca03d0161d7 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:05.969477 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d2f1db76-6994-43cf-8c9c-2ca03d0161d7 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:05.969477 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d2f1db76-6994-43cf-8c9c-2ca03d0161d7 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:05.971775 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d2f1db76-6994-43cf-8c9c-2ca03d0161d7 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:05.976484 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d2f1db76-6994-43cf-8c9c-2ca03d0161d7 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:05.977212 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d2f1db76-6994-43cf-8c9c-2ca03d0161d7 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:06.054555 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d2f1db76-6994-43cf-8c9c-2ca03d0161d7 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:06.055394 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d2f1db76-6994-43cf-8c9c-2ca03d0161d7 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:06.056059 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d2f1db76-6994-43cf-8c9c-2ca03d0161d7 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:06.058397 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.objects.instance [None req-d2f1db76-6994-43cf-8c9c-2ca03d0161d7 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lazy-loading 'fault' on Instance uuid 44d8e487-b994-45ac-b2e4-47a6b7d425fe {{(pid=125872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:57:06.140950 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-d2f1db76-6994-43cf-8c9c-2ca03d0161d7 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:06.149290 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-d2f1db76-6994-43cf-8c9c-2ca03d0161d7 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/44d8e487-b994-45ac-b2e4-47a6b7d425fe" status: 200 len: 1332 microversion: 2.1 time: 0.204200 Oct 17 03:57:06.153258 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 242/485] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:05 2022] GET /compute/v2.1/servers/44d8e487-b994-45ac-b2e4-47a6b7d425fe => generated 1332 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:06.505183 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-aaa35a06-8dbd-4c61-ad15-8632b27a6e9e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:06.507430 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-aaa35a06-8dbd-4c61-ad15-8632b27a6e9e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:06.528134 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-aaa35a06-8dbd-4c61-ad15-8632b27a6e9e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:06.538391 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-aaa35a06-8dbd-4c61-ad15-8632b27a6e9e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:06.552361 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-aaa35a06-8dbd-4c61-ad15-8632b27a6e9e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:06.553425 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-aaa35a06-8dbd-4c61-ad15-8632b27a6e9e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:06.554061 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-aaa35a06-8dbd-4c61-ad15-8632b27a6e9e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:06.554681 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-aaa35a06-8dbd-4c61-ad15-8632b27a6e9e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:06.840417 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-aaa35a06-8dbd-4c61-ad15-8632b27a6e9e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:06.846507 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [req-6e79728d-621e-4071-982a-e1373adab508 req-87a1db23-ab2d-40fb-8a5e-564d66b23754 admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "6ac06077-c340-4a57-85e2-ff15f90f7662", "create_info": {"type": "qcow2", "new_file": "volume-6ac06077-c340-4a57-85e2-ff15f90f7662.dfe375c8-a4ff-4163-b163-5550a5cdbb4a.vhdx", "snapshot_id": "dfe375c8-a4ff-4163-b163-5550a5cdbb4a"}}} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:57:06.852831 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-6e79728d-621e-4071-982a-e1373adab508 req-87a1db23-ab2d-40fb-8a5e-564d66b23754 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:06.853332 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-6e79728d-621e-4071-982a-e1373adab508 req-87a1db23-ab2d-40fb-8a5e-564d66b23754 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:06.853770 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-6e79728d-621e-4071-982a-e1373adab508 req-87a1db23-ab2d-40fb-8a5e-564d66b23754 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:06.860791 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-aaa35a06-8dbd-4c61-ad15-8632b27a6e9e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:06.862260 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-aaa35a06-8dbd-4c61-ad15-8632b27a6e9e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:06.888947 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-aaa35a06-8dbd-4c61-ad15-8632b27a6e9e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1739 microversion: 2.20 time: 0.362196 Oct 17 03:57:06.889620 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 244/486] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:57:06 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1739 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:57:06.906239 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-6e79728d-621e-4071-982a-e1373adab508 req-87a1db23-ab2d-40fb-8a5e-564d66b23754 admin admin] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:06.907034 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-6e79728d-621e-4071-982a-e1373adab508 req-87a1db23-ab2d-40fb-8a5e-564d66b23754 admin admin] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:06.907888 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-6e79728d-621e-4071-982a-e1373adab508 req-87a1db23-ab2d-40fb-8a5e-564d66b23754 admin admin] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:06.936095 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [req-6e79728d-621e-4071-982a-e1373adab508 req-87a1db23-ab2d-40fb-8a5e-564d66b23754 admin admin] 10.222.0.43 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.222795 Oct 17 03:57:06.937322 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 243/487] 10.222.0.43 () {64 vars in 1326 bytes} [Mon Oct 17 03:57:06 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 17 03:57:07.179544 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-a1abb0c8-52ac-4613-b281-d2b97d4d220a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:07.180183 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-a1abb0c8-52ac-4613-b281-d2b97d4d220a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 44d8e487-b994-45ac-b2e4-47a6b7d425fe] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:07.191681 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a1abb0c8-52ac-4613-b281-d2b97d4d220a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:07.192216 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a1abb0c8-52ac-4613-b281-d2b97d4d220a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:07.192665 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a1abb0c8-52ac-4613-b281-d2b97d4d220a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:07.193397 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a1abb0c8-52ac-4613-b281-d2b97d4d220a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:07.195546 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a1abb0c8-52ac-4613-b281-d2b97d4d220a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:07.199521 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a1abb0c8-52ac-4613-b281-d2b97d4d220a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:07.245701 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.wsgi [None req-a1abb0c8-52ac-4613-b281-d2b97d4d220a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] HTTP exception thrown: Instance 44d8e487-b994-45ac-b2e4-47a6b7d425fe could not be found. Oct 17 03:57:07.247457 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-a1abb0c8-52ac-4613-b281-d2b97d4d220a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Request method failure captured: Oct 17 03:57:07.247457 dv-cinder-815582-16-smb devstack@n-api.service[125871]: request: GET /compute/v2.1/servers/44d8e487-b994-45ac-b2e4-47a6b7d425fe HTTP/1.1 Oct 17 03:57:07.247457 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Accept: application/json Oct 17 03:57:07.247457 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Accept-Encoding: identity Oct 17 03:57:07.247457 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Connection: close Oct 17 03:57:07.247457 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Content-Length: 0 Oct 17 03:57:07.247457 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Content-Type: application/json Oct 17 03:57:07.247457 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Host: 10.222.0.16 Oct 17 03:57:07.247457 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Openstack-System-Scope: None Oct 17 03:57:07.247457 dv-cinder-815582-16-smb devstack@n-api.service[125871]: User-Agent: python-urllib3/1.26.12 Oct 17 03:57:07.247457 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Auth-Token: gAAAAABjTNHS-JkBpYGlE8smCEkK5jojHou0K6VK_tNmdNYF8mJS0isG5A2O-CJO1Z0ixcowhaVCDpWbdKHf1nvQBjXwKqEHeDqSudyXAc3IKeNiaKgebnu28MS5PTi1Pi3TKRwLiMEjkJOln2AC5NFbphJ0QfPkQ085FD6azHU6IqdftqedhcI Oct 17 03:57:07.247457 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Domain-Id: None Oct 17 03:57:07.247457 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Domain-Name: None Oct 17 03:57:07.247457 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Identity-Status: Confirmed Oct 17 03:57:07.247457 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Is-Admin-Project: True Oct 17 03:57:07.247457 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Domain-Id: default Oct 17 03:57:07.247457 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Domain-Name: Default Oct 17 03:57:07.247457 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Id: 8af3ce80f169473882a247ba78d3d6ef Oct 17 03:57:07.247457 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Name: tempest-AttachVolumeNegativeTest-973579303 Oct 17 03:57:07.247457 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Role: reader,member Oct 17 03:57:07.247457 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Roles: reader,member Oct 17 03:57:07.248945 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8af3ce80f169473882a247ba78d3d6ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8af3ce80f169473882a247ba78d3d6ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8af3ce80f169473882a247ba78d3d6ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8af3ce80f169473882a247ba78d3d6ef", "adminURL": "http://10.222.0.16:8080"}]}] Oct 17 03:57:07.248945 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant: tempest-AttachVolumeNegativeTest-973579303 Oct 17 03:57:07.248945 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant-Id: 8af3ce80f169473882a247ba78d3d6ef Oct 17 03:57:07.248945 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-973579303 Oct 17 03:57:07.248945 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User: tempest-AttachVolumeNegativeTest-973579303-project Oct 17 03:57:07.248945 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Domain-Id: default Oct 17 03:57:07.248945 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Domain-Name: Default Oct 17 03:57:07.248945 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Id: e9ac14bb6ceb4d9a92a20938e9688bbd Oct 17 03:57:07.248945 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Name: tempest-AttachVolumeNegativeTest-973579303-project Oct 17 03:57:07.248945 dv-cinder-815582-16-smb devstack@n-api.service[125871]: method: > Oct 17 03:57:07.248945 dv-cinder-815582-16-smb devstack@n-api.service[125871]: exception: Instance 44d8e487-b994-45ac-b2e4-47a6b7d425fe could not be found. Oct 17 03:57:07.248945 dv-cinder-815582-16-smb devstack@n-api.service[125871]: action_args: {'id': '44d8e487-b994-45ac-b2e4-47a6b7d425fe'} Oct 17 03:57:07.249803 dv-cinder-815582-16-smb devstack@n-api.service[125871]: {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:57:07.249803 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:57:07.249803 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 03:57:07.249803 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 03:57:07.249803 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 03:57:07.249803 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 03:57:07.249803 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 03:57:07.249803 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 03:57:07.249803 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 03:57:07.249803 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 03:57:07.249803 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44d8e487-b994-45ac-b2e4-47a6b7d425fe could not be found. Oct 17 03:57:07.249803 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:57:07.249803 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:57:07.249803 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:57:07.249803 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:57:07.249803 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:57:07.249803 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:57:07.249803 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:57:07.249803 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:57:07.249803 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:57:07.251852 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:57:07.251852 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 03:57:07.251852 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 03:57:07.251852 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 03:57:07.251852 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 03:57:07.251852 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 03:57:07.251852 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:57:07.251852 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44d8e487-b994-45ac-b2e4-47a6b7d425fe could not be found. Oct 17 03:57:07.251852 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:57:07.251852 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:57:07.251852 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:57:07.251852 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:57:07.251852 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:57:07.251852 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:57:07.251852 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:57:07.251852 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:57:07.251852 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44d8e487-b994-45ac-b2e4-47a6b7d425fe could not be found. Oct 17 03:57:07.251852 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:57:07.253590 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-a1abb0c8-52ac-4613-b281-d2b97d4d220a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Returning 404 to user: Instance 44d8e487-b994-45ac-b2e4-47a6b7d425fe could not be found. {{(pid=125871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:57:07.253590 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-a1abb0c8-52ac-4613-b281-d2b97d4d220a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/44d8e487-b994-45ac-b2e4-47a6b7d425fe" status: 404 len: 111 microversion: 2.1 time: 0.073340 Oct 17 03:57:07.259616 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-2a4068fe-bd68-4da9-94e3-6588ada7267e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '.version_select at 0x7fd72a7fac10>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:07.263120 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 245/488] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:07 2022] GET /compute/v2.1/servers/44d8e487-b994-45ac-b2e4-47a6b7d425fe => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 03:57:07.374509 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-2a4068fe-bd68-4da9-94e3-6588ada7267e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1013327654" status: 202 len: 0 microversion: 2.1 time: 0.119531 Oct 17 03:57:07.380253 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 244/489] 10.222.0.16 () {58 vars in 1221 bytes} [Mon Oct 17 03:57:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1013327654 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 03:57:07.763063 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-4af7c703-0784-4be0-a337-5f118c2741e9 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:57:07.773087 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-4af7c703-0784-4be0-a337-5f118c2741e9 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:07.773747 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-4af7c703-0784-4be0-a337-5f118c2741e9 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:07.774574 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-4af7c703-0784-4be0-a337-5f118c2741e9 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:07.828973 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-4af7c703-0784-4be0-a337-5f118c2741e9 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Going to try to stop instance {{(pid=125871) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 17 03:57:07.921791 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-9daf419a-73ee-40f5-bc14-f88d722c9a3a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:07.922621 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-9daf419a-73ee-40f5-bc14-f88d722c9a3a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:07.970256 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-9daf419a-73ee-40f5-bc14-f88d722c9a3a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:07.970783 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-9daf419a-73ee-40f5-bc14-f88d722c9a3a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:07.971246 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-9daf419a-73ee-40f5-bc14-f88d722c9a3a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:07.971985 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-9daf419a-73ee-40f5-bc14-f88d722c9a3a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:07.972450 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-9daf419a-73ee-40f5-bc14-f88d722c9a3a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:07.972874 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-9daf419a-73ee-40f5-bc14-f88d722c9a3a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:08.076255 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-4af7c703-0784-4be0-a337-5f118c2741e9 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "POST /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe/action" status: 202 len: 0 microversion: 2.1 time: 0.324050 Oct 17 03:57:08.077461 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 246/490] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 17 03:57:07 2022] POST /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe/action => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 03:57:08.090330 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-4778765b-9f5c-4109-918f-9129884dde76 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:08.095329 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-4778765b-9f5c-4109-918f-9129884dde76 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:08.107525 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-4778765b-9f5c-4109-918f-9129884dde76 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:08.108306 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-4778765b-9f5c-4109-918f-9129884dde76 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:08.109764 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-4778765b-9f5c-4109-918f-9129884dde76 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:08.112914 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-4778765b-9f5c-4109-918f-9129884dde76 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:08.113644 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-4778765b-9f5c-4109-918f-9129884dde76 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:08.114240 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-4778765b-9f5c-4109-918f-9129884dde76 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:08.473954 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-4778765b-9f5c-4109-918f-9129884dde76 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:08.482503 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-4778765b-9f5c-4109-918f-9129884dde76 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1678 microversion: 2.1 time: 0.400692 Oct 17 03:57:08.507045 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 247/491] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:08 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1678 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:08.647038 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-9daf419a-73ee-40f5-bc14-f88d722c9a3a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:08.708907 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-9daf419a-73ee-40f5-bc14-f88d722c9a3a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:08.710714 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-9daf419a-73ee-40f5-bc14-f88d722c9a3a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:08.742752 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-9daf419a-73ee-40f5-bc14-f88d722c9a3a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1739 microversion: 2.20 time: 0.813717 Oct 17 03:57:08.742981 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 245/492] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:57:07 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1739 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:57:09.514847 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-1a3d020d-a47c-40f4-8c46-b7eec12761ed tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:09.515657 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-1a3d020d-a47c-40f4-8c46-b7eec12761ed tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:09.519345 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_cell0:SELECT=2 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:57:09.523675 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1a3d020d-a47c-40f4-8c46-b7eec12761ed tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:09.524436 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1a3d020d-a47c-40f4-8c46-b7eec12761ed tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:09.525053 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1a3d020d-a47c-40f4-8c46-b7eec12761ed tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:09.526077 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1a3d020d-a47c-40f4-8c46-b7eec12761ed tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:09.527456 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1a3d020d-a47c-40f4-8c46-b7eec12761ed tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:09.528124 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1a3d020d-a47c-40f4-8c46-b7eec12761ed tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:09.565033 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-88dee698-75c8-4b8c-9d94-adabf84e6f69 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:09.565033 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-88dee698-75c8-4b8c-9d94-adabf84e6f69 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: ff49fd54-9ddf-415d-8eb4-fb1b0bef634c] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:09.572636 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-88dee698-75c8-4b8c-9d94-adabf84e6f69 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:09.575208 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-88dee698-75c8-4b8c-9d94-adabf84e6f69 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:09.575208 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-88dee698-75c8-4b8c-9d94-adabf84e6f69 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:09.575208 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-88dee698-75c8-4b8c-9d94-adabf84e6f69 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:09.579098 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-88dee698-75c8-4b8c-9d94-adabf84e6f69 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:09.579098 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-88dee698-75c8-4b8c-9d94-adabf84e6f69 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:09.670765 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.objects.instance [None req-88dee698-75c8-4b8c-9d94-adabf84e6f69 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lazy-loading 'services' on Instance uuid ff49fd54-9ddf-415d-8eb4-fb1b0bef634c {{(pid=125872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:57:09.693208 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-1a3d020d-a47c-40f4-8c46-b7eec12761ed tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:09.702144 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-1a3d020d-a47c-40f4-8c46-b7eec12761ed tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1678 microversion: 2.1 time: 0.191898 Oct 17 03:57:09.702877 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 248/493] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:09 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1678 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:09.774433 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-b4c06f29-bc41-457f-b808-0a18f4f22357 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:09.775346 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-b4c06f29-bc41-457f-b808-0a18f4f22357 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:09.785550 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b4c06f29-bc41-457f-b808-0a18f4f22357 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:09.786033 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b4c06f29-bc41-457f-b808-0a18f4f22357 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:09.786640 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b4c06f29-bc41-457f-b808-0a18f4f22357 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:09.789783 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b4c06f29-bc41-457f-b808-0a18f4f22357 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:09.789783 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b4c06f29-bc41-457f-b808-0a18f4f22357 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:09.789783 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b4c06f29-bc41-457f-b808-0a18f4f22357 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:09.923851 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-88dee698-75c8-4b8c-9d94-adabf84e6f69 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c/os-volume_attachments/b4dfc0cd-7015-4b84-b8f9-f29eef843f13" status: 202 len: 0 microversion: 2.1 time: 0.359965 Oct 17 03:57:09.935210 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 246/494] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Oct 17 03:57:09 2022] DELETE /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c/os-volume_attachments/b4dfc0cd-7015-4b84-b8f9-f29eef843f13 => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 03:57:09.947490 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-315e6156-66e8-4a63-ba60-c15375ddf812 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:09.966162 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-315e6156-66e8-4a63-ba60-c15375ddf812 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: ff49fd54-9ddf-415d-8eb4-fb1b0bef634c] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:09.991966 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-315e6156-66e8-4a63-ba60-c15375ddf812 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:09.996266 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-315e6156-66e8-4a63-ba60-c15375ddf812 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:09.999741 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-315e6156-66e8-4a63-ba60-c15375ddf812 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:10.003963 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-315e6156-66e8-4a63-ba60-c15375ddf812 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:10.005254 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-315e6156-66e8-4a63-ba60-c15375ddf812 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:10.006436 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-315e6156-66e8-4a63-ba60-c15375ddf812 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:10.121856 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-315e6156-66e8-4a63-ba60-c15375ddf812 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.180711 Oct 17 03:57:10.129627 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 247/495] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 17 03:57:09 2022] GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c/os-volume_attachments => generated 197 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:57:10.188776 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-b4c06f29-bc41-457f-b808-0a18f4f22357 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:10.205555 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-b4c06f29-bc41-457f-b808-0a18f4f22357 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:10.207644 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-b4c06f29-bc41-457f-b808-0a18f4f22357 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:10.208798 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-b4c06f29-bc41-457f-b808-0a18f4f22357 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1739 microversion: 2.20 time: 0.438358 Oct 17 03:57:10.209338 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 249/496] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:57:09 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1739 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:57:10.731853 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-f1fff067-3c4f-4571-a244-1b675f71cc34 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:10.732965 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-f1fff067-3c4f-4571-a244-1b675f71cc34 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:10.751873 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f1fff067-3c4f-4571-a244-1b675f71cc34 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:10.751873 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f1fff067-3c4f-4571-a244-1b675f71cc34 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:10.751873 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f1fff067-3c4f-4571-a244-1b675f71cc34 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:10.752806 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f1fff067-3c4f-4571-a244-1b675f71cc34 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:10.753287 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f1fff067-3c4f-4571-a244-1b675f71cc34 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:10.753963 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f1fff067-3c4f-4571-a244-1b675f71cc34 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:10.921601 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-f1fff067-3c4f-4571-a244-1b675f71cc34 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:10.931662 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-f1fff067-3c4f-4571-a244-1b675f71cc34 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1678 microversion: 2.1 time: 0.208924 Oct 17 03:57:10.933635 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 248/497] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:10 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1678 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:11.142246 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-c9050255-1231-4fc4-a6f9-da9c3ea8180c tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:11.144460 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-c9050255-1231-4fc4-a6f9-da9c3ea8180c tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: ff49fd54-9ddf-415d-8eb4-fb1b0bef634c] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:11.157504 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c9050255-1231-4fc4-a6f9-da9c3ea8180c tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:11.157999 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c9050255-1231-4fc4-a6f9-da9c3ea8180c tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:11.160298 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c9050255-1231-4fc4-a6f9-da9c3ea8180c tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:11.160298 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c9050255-1231-4fc4-a6f9-da9c3ea8180c tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:11.160298 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c9050255-1231-4fc4-a6f9-da9c3ea8180c tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:11.160298 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c9050255-1231-4fc4-a6f9-da9c3ea8180c tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:11.199124 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:57:11.205413 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-c9050255-1231-4fc4-a6f9-da9c3ea8180c tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.066409 Oct 17 03:57:11.206030 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 250/498] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 17 03:57:11 2022] GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 03:57:11.237700 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-440542b8-f65c-4005-8565-3f8528e13361 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:11.238303 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-440542b8-f65c-4005-8565-3f8528e13361 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:11.245558 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-440542b8-f65c-4005-8565-3f8528e13361 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:11.245946 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-440542b8-f65c-4005-8565-3f8528e13361 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:11.246376 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-440542b8-f65c-4005-8565-3f8528e13361 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:11.247283 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-440542b8-f65c-4005-8565-3f8528e13361 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:11.247890 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-440542b8-f65c-4005-8565-3f8528e13361 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:11.248469 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-440542b8-f65c-4005-8565-3f8528e13361 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:11.297634 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-8e435313-2329-4cfa-b6a6-60b35554e86e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:11.298140 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-8e435313-2329-4cfa-b6a6-60b35554e86e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: ff49fd54-9ddf-415d-8eb4-fb1b0bef634c] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:11.309150 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8e435313-2329-4cfa-b6a6-60b35554e86e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:11.311674 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8e435313-2329-4cfa-b6a6-60b35554e86e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:11.312129 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8e435313-2329-4cfa-b6a6-60b35554e86e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:11.312847 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8e435313-2329-4cfa-b6a6-60b35554e86e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:11.313308 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8e435313-2329-4cfa-b6a6-60b35554e86e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:11.314747 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8e435313-2329-4cfa-b6a6-60b35554e86e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:11.365600 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-8e435313-2329-4cfa-b6a6-60b35554e86e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: ff49fd54-9ddf-415d-8eb4-fb1b0bef634c] Going to try to terminate instance {{(pid=125871) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 03:57:11.432974 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-440542b8-f65c-4005-8565-3f8528e13361 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:11.441710 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-440542b8-f65c-4005-8565-3f8528e13361 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:11.443360 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-440542b8-f65c-4005-8565-3f8528e13361 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:11.444820 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-440542b8-f65c-4005-8565-3f8528e13361 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1739 microversion: 2.20 time: 0.210782 Oct 17 03:57:11.445738 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 249/499] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:57:11 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1739 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:57:11.659474 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-8e435313-2329-4cfa-b6a6-60b35554e86e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c" status: 204 len: 0 microversion: 2.1 time: 0.365280 Oct 17 03:57:11.660363 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 251/500] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 17 03:57:11 2022] DELETE /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 03:57:11.670697 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-93c88a2c-5cab-4c7a-919a-fa2b6f17d3e2 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:11.671666 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-93c88a2c-5cab-4c7a-919a-fa2b6f17d3e2 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: ff49fd54-9ddf-415d-8eb4-fb1b0bef634c] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:11.679705 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-93c88a2c-5cab-4c7a-919a-fa2b6f17d3e2 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:11.680410 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-93c88a2c-5cab-4c7a-919a-fa2b6f17d3e2 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:11.680915 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-93c88a2c-5cab-4c7a-919a-fa2b6f17d3e2 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:11.681789 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-93c88a2c-5cab-4c7a-919a-fa2b6f17d3e2 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:11.682512 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-93c88a2c-5cab-4c7a-919a-fa2b6f17d3e2 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:11.683051 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-93c88a2c-5cab-4c7a-919a-fa2b6f17d3e2 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:11.741691 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [req-5c6bc4e9-7443-430c-adf4-5d739973df96 req-e3e38938-ade7-47bd-b883-891195ce1fb5 admin admin] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:11.746387 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-5c6bc4e9-7443-430c-adf4-5d739973df96 req-e3e38938-ade7-47bd-b883-891195ce1fb5 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:11.747193 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-5c6bc4e9-7443-430c-adf4-5d739973df96 req-e3e38938-ade7-47bd-b883-891195ce1fb5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:11.748556 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-5c6bc4e9-7443-430c-adf4-5d739973df96 req-e3e38938-ade7-47bd-b883-891195ce1fb5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:11.773376 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-5c6bc4e9-7443-430c-adf4-5d739973df96 req-e3e38938-ade7-47bd-b883-891195ce1fb5 admin admin] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:11.773376 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-5c6bc4e9-7443-430c-adf4-5d739973df96 req-e3e38938-ade7-47bd-b883-891195ce1fb5 admin admin] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:11.773376 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-5c6bc4e9-7443-430c-adf4-5d739973df96 req-e3e38938-ade7-47bd-b883-891195ce1fb5 admin admin] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:11.788732 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [req-5c6bc4e9-7443-430c-adf4-5d739973df96 req-e3e38938-ade7-47bd-b883-891195ce1fb5 admin admin] 10.222.0.43 "DELETE /compute/v2.1/os-assisted-volume-snapshots/ace0e160-9774-4788-abe7-42f21e6007f4?delete_info=%7B%22file_to_merge%22:%20%22volume-6ac06077-c340-4a57-85e2-ff15f90f7662.ace0e160-9774-4788-abe7-42f21e6007f4.vhdx%22,%20%22volume_id%22:%20%226ac06077-c340-4a57-85e2-ff15f90f7662%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.142159 Oct 17 03:57:11.789933 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 250/501] 10.222.0.43 () {62 vars in 1800 bytes} [Mon Oct 17 03:57:11 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/ace0e160-9774-4788-abe7-42f21e6007f4?delete_info=%7B%22file_to_merge%22:%20%22volume-6ac06077-c340-4a57-85e2-ff15f90f7662.ace0e160-9774-4788-abe7-42f21e6007f4.vhdx%22,%20%22volume_id%22:%20%226ac06077-c340-4a57-85e2-ff15f90f7662%22%7D => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 03:57:11.855244 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-93c88a2c-5cab-4c7a-919a-fa2b6f17d3e2 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:11.863972 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-93c88a2c-5cab-4c7a-919a-fa2b6f17d3e2 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c" status: 200 len: 1682 microversion: 2.1 time: 0.198678 Oct 17 03:57:11.864552 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 252/502] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:11 2022] GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c => generated 1682 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:11.961071 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-78327262-00d0-46c9-98d4-5fe21a3b91d9 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:11.962174 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-78327262-00d0-46c9-98d4-5fe21a3b91d9 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:11.969768 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-78327262-00d0-46c9-98d4-5fe21a3b91d9 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:11.970817 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-78327262-00d0-46c9-98d4-5fe21a3b91d9 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:11.971293 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-78327262-00d0-46c9-98d4-5fe21a3b91d9 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:11.972041 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-78327262-00d0-46c9-98d4-5fe21a3b91d9 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:11.972459 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-78327262-00d0-46c9-98d4-5fe21a3b91d9 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:11.973085 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-78327262-00d0-46c9-98d4-5fe21a3b91d9 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:11.993021 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=3 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:57:12.112420 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-78327262-00d0-46c9-98d4-5fe21a3b91d9 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:12.120917 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-78327262-00d0-46c9-98d4-5fe21a3b91d9 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1678 microversion: 2.1 time: 0.164633 Oct 17 03:57:12.121742 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 251/503] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:11 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:12.473752 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-b76a0d76-6a7a-4246-862e-257c15d7a094 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:12.474374 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-b76a0d76-6a7a-4246-862e-257c15d7a094 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:12.481649 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b76a0d76-6a7a-4246-862e-257c15d7a094 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:12.482145 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b76a0d76-6a7a-4246-862e-257c15d7a094 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:12.482575 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b76a0d76-6a7a-4246-862e-257c15d7a094 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:12.483303 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b76a0d76-6a7a-4246-862e-257c15d7a094 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:12.483764 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b76a0d76-6a7a-4246-862e-257c15d7a094 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:12.491115 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b76a0d76-6a7a-4246-862e-257c15d7a094 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:12.642248 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-b76a0d76-6a7a-4246-862e-257c15d7a094 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:12.651720 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-b76a0d76-6a7a-4246-862e-257c15d7a094 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:12.653378 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-b76a0d76-6a7a-4246-862e-257c15d7a094 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:12.654511 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-b76a0d76-6a7a-4246-862e-257c15d7a094 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1721 microversion: 2.20 time: 0.184699 Oct 17 03:57:12.655446 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 253/504] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:57:12 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1721 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:57:12.888619 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-36f9ecd3-943b-4ab2-851a-c998d6975e1e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:12.889230 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-36f9ecd3-943b-4ab2-851a-c998d6975e1e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: ff49fd54-9ddf-415d-8eb4-fb1b0bef634c] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:12.896125 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-36f9ecd3-943b-4ab2-851a-c998d6975e1e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:12.896615 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-36f9ecd3-943b-4ab2-851a-c998d6975e1e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:12.897048 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-36f9ecd3-943b-4ab2-851a-c998d6975e1e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:12.897760 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-36f9ecd3-943b-4ab2-851a-c998d6975e1e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:12.898287 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-36f9ecd3-943b-4ab2-851a-c998d6975e1e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:12.898715 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-36f9ecd3-943b-4ab2-851a-c998d6975e1e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:13.046738 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-36f9ecd3-943b-4ab2-851a-c998d6975e1e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:13.054440 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-36f9ecd3-943b-4ab2-851a-c998d6975e1e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c" status: 200 len: 1682 microversion: 2.1 time: 0.171072 Oct 17 03:57:13.055009 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 252/505] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:12 2022] GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:13.146075 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-aafc3929-6f8c-498a-b37e-3f9e6d0c9c22 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:13.146803 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-aafc3929-6f8c-498a-b37e-3f9e6d0c9c22 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:13.153167 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-aafc3929-6f8c-498a-b37e-3f9e6d0c9c22 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:13.153858 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-aafc3929-6f8c-498a-b37e-3f9e6d0c9c22 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:13.154399 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-aafc3929-6f8c-498a-b37e-3f9e6d0c9c22 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:13.155391 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-aafc3929-6f8c-498a-b37e-3f9e6d0c9c22 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:13.155993 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-aafc3929-6f8c-498a-b37e-3f9e6d0c9c22 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:13.156515 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-aafc3929-6f8c-498a-b37e-3f9e6d0c9c22 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:13.314551 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-aafc3929-6f8c-498a-b37e-3f9e6d0c9c22 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:13.322757 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-aafc3929-6f8c-498a-b37e-3f9e6d0c9c22 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1678 microversion: 2.1 time: 0.181219 Oct 17 03:57:13.337092 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 254/506] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:13 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1678 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:13.681522 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-afd4bd9c-26a9-466a-b848-29cc1676ccb2 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:13.682555 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-afd4bd9c-26a9-466a-b848-29cc1676ccb2 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:13.689113 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-afd4bd9c-26a9-466a-b848-29cc1676ccb2 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:13.689737 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-afd4bd9c-26a9-466a-b848-29cc1676ccb2 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:13.690345 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-afd4bd9c-26a9-466a-b848-29cc1676ccb2 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:13.691244 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-afd4bd9c-26a9-466a-b848-29cc1676ccb2 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:13.691774 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-afd4bd9c-26a9-466a-b848-29cc1676ccb2 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:13.692332 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-afd4bd9c-26a9-466a-b848-29cc1676ccb2 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:13.879970 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-afd4bd9c-26a9-466a-b848-29cc1676ccb2 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:13.889285 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-afd4bd9c-26a9-466a-b848-29cc1676ccb2 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:13.891013 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-afd4bd9c-26a9-466a-b848-29cc1676ccb2 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:13.892293 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-afd4bd9c-26a9-466a-b848-29cc1676ccb2 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1721 microversion: 2.20 time: 0.214950 Oct 17 03:57:13.893266 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 253/507] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:57:13 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1721 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:57:14.079911 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-53f4ee96-d09d-481f-b368-7db20c09cb08 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:14.081201 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-53f4ee96-d09d-481f-b368-7db20c09cb08 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: ff49fd54-9ddf-415d-8eb4-fb1b0bef634c] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:14.092829 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-53f4ee96-d09d-481f-b368-7db20c09cb08 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:14.093337 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-53f4ee96-d09d-481f-b368-7db20c09cb08 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:14.093784 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-53f4ee96-d09d-481f-b368-7db20c09cb08 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:14.094487 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-53f4ee96-d09d-481f-b368-7db20c09cb08 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:14.095141 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-53f4ee96-d09d-481f-b368-7db20c09cb08 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:14.095764 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-53f4ee96-d09d-481f-b368-7db20c09cb08 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:14.247618 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-53f4ee96-d09d-481f-b368-7db20c09cb08 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:14.256348 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-53f4ee96-d09d-481f-b368-7db20c09cb08 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c" status: 200 len: 1682 microversion: 2.1 time: 0.181616 Oct 17 03:57:14.272442 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 255/508] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:14 2022] GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c => generated 1682 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:14.348029 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-c14643a6-737f-4d8d-9f28-815f5c8157aa tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:14.349294 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-c14643a6-737f-4d8d-9f28-815f5c8157aa tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:14.359456 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c14643a6-737f-4d8d-9f28-815f5c8157aa tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:14.360317 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c14643a6-737f-4d8d-9f28-815f5c8157aa tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:14.361208 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c14643a6-737f-4d8d-9f28-815f5c8157aa tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:14.362297 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c14643a6-737f-4d8d-9f28-815f5c8157aa tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:14.362917 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c14643a6-737f-4d8d-9f28-815f5c8157aa tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:14.363836 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c14643a6-737f-4d8d-9f28-815f5c8157aa tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:14.528623 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-c14643a6-737f-4d8d-9f28-815f5c8157aa tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:14.533626 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-c14643a6-737f-4d8d-9f28-815f5c8157aa tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1678 microversion: 2.1 time: 0.190347 Oct 17 03:57:14.534637 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 254/509] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:14 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1678 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:14.918625 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-8428095d-d7f6-42c8-a3d0-57ac325d6ed0 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:14.919267 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-8428095d-d7f6-42c8-a3d0-57ac325d6ed0 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:14.927119 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8428095d-d7f6-42c8-a3d0-57ac325d6ed0 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:14.927643 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8428095d-d7f6-42c8-a3d0-57ac325d6ed0 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:14.928077 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8428095d-d7f6-42c8-a3d0-57ac325d6ed0 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:14.928988 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8428095d-d7f6-42c8-a3d0-57ac325d6ed0 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:14.929222 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8428095d-d7f6-42c8-a3d0-57ac325d6ed0 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:14.929641 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8428095d-d7f6-42c8-a3d0-57ac325d6ed0 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:15.180097 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [req-aea00252-4e50-4657-abce-28cbb1c0e7e7 req-eeb8a15b-08df-42ce-bfaf-441c8066875c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff49fd54-9ddf-415d-8eb4-fb1b0bef634c", "name": "network-vif-unplugged", "status": "completed", "tag": "f99713b4-2587-4880-bc02-eb025501171c"}]} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:57:15.206095 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-aea00252-4e50-4657-abce-28cbb1c0e7e7 req-eeb8a15b-08df-42ce-bfaf-441c8066875c service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:15.206575 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-aea00252-4e50-4657-abce-28cbb1c0e7e7 req-eeb8a15b-08df-42ce-bfaf-441c8066875c service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:15.210956 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-aea00252-4e50-4657-abce-28cbb1c0e7e7 req-eeb8a15b-08df-42ce-bfaf-441c8066875c service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:15.226749 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.compute.server_external_events [req-aea00252-4e50-4657-abce-28cbb1c0e7e7 req-eeb8a15b-08df-42ce-bfaf-441c8066875c service nova] Creating event network-vif-unplugged:f99713b4-2587-4880-bc02-eb025501171c for instance ff49fd54-9ddf-415d-8eb4-fb1b0bef634c on hv-cinder-81558 Oct 17 03:57:15.234439 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [req-aea00252-4e50-4657-abce-28cbb1c0e7e7 req-eeb8a15b-08df-42ce-bfaf-441c8066875c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058344 Oct 17 03:57:15.235695 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 255/510] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 03:57:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 03:57:15.284029 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-bc002f8f-78f6-47ba-8127-1c41975c9d9d tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:15.284676 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-bc002f8f-78f6-47ba-8127-1c41975c9d9d tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: ff49fd54-9ddf-415d-8eb4-fb1b0bef634c] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:15.300063 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-bc002f8f-78f6-47ba-8127-1c41975c9d9d tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:15.300823 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-bc002f8f-78f6-47ba-8127-1c41975c9d9d tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:15.302207 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-bc002f8f-78f6-47ba-8127-1c41975c9d9d tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:15.303295 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-bc002f8f-78f6-47ba-8127-1c41975c9d9d tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:15.303934 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-bc002f8f-78f6-47ba-8127-1c41975c9d9d tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:15.304524 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-bc002f8f-78f6-47ba-8127-1c41975c9d9d tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:15.311809 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-8428095d-d7f6-42c8-a3d0-57ac325d6ed0 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:15.320399 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-8428095d-d7f6-42c8-a3d0-57ac325d6ed0 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:15.324863 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-8428095d-d7f6-42c8-a3d0-57ac325d6ed0 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:15.329017 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-8428095d-d7f6-42c8-a3d0-57ac325d6ed0 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1721 microversion: 2.20 time: 0.414781 Oct 17 03:57:15.349505 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 256/511] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:57:14 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1721 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:57:15.492471 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-bc002f8f-78f6-47ba-8127-1c41975c9d9d tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:15.501843 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-bc002f8f-78f6-47ba-8127-1c41975c9d9d tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c" status: 200 len: 1682 microversion: 2.1 time: 0.222924 Oct 17 03:57:15.502961 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 256/512] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:15 2022] GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c => generated 1682 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:57:15.557641 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-3d9ce144-a6d1-4524-8c9f-ffc64dfaad97 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:15.558620 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-3d9ce144-a6d1-4524-8c9f-ffc64dfaad97 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:15.565156 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3d9ce144-a6d1-4524-8c9f-ffc64dfaad97 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:15.565741 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3d9ce144-a6d1-4524-8c9f-ffc64dfaad97 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:15.567392 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3d9ce144-a6d1-4524-8c9f-ffc64dfaad97 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:15.567392 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3d9ce144-a6d1-4524-8c9f-ffc64dfaad97 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:15.568289 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3d9ce144-a6d1-4524-8c9f-ffc64dfaad97 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:15.568793 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3d9ce144-a6d1-4524-8c9f-ffc64dfaad97 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:15.842476 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-3d9ce144-a6d1-4524-8c9f-ffc64dfaad97 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:15.852103 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-3d9ce144-a6d1-4524-8c9f-ffc64dfaad97 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1678 microversion: 2.1 time: 0.298136 Oct 17 03:57:15.867199 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 257/513] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:15 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1678 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:16.358698 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-cedc9a79-ab11-4495-8a98-f4ea5d97076e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:16.360171 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-cedc9a79-ab11-4495-8a98-f4ea5d97076e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:16.367079 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-cedc9a79-ab11-4495-8a98-f4ea5d97076e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:16.367889 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-cedc9a79-ab11-4495-8a98-f4ea5d97076e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:16.369045 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-cedc9a79-ab11-4495-8a98-f4ea5d97076e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:16.371564 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-cedc9a79-ab11-4495-8a98-f4ea5d97076e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:16.372098 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-cedc9a79-ab11-4495-8a98-f4ea5d97076e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:16.372584 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-cedc9a79-ab11-4495-8a98-f4ea5d97076e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:16.504404 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [req-f54947b7-c63e-4425-a988-ccd3c78816d1 req-0a44a78b-024b-49a2-a37c-55657fb9d0fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff49fd54-9ddf-415d-8eb4-fb1b0bef634c", "name": "network-vif-deleted", "tag": "f99713b4-2587-4880-bc02-eb025501171c"}]} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:57:16.538514 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-f54947b7-c63e-4425-a988-ccd3c78816d1 req-0a44a78b-024b-49a2-a37c-55657fb9d0fa service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:16.539050 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-f54947b7-c63e-4425-a988-ccd3c78816d1 req-0a44a78b-024b-49a2-a37c-55657fb9d0fa service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:16.539524 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-f54947b7-c63e-4425-a988-ccd3c78816d1 req-0a44a78b-024b-49a2-a37c-55657fb9d0fa service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:16.571085 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.compute.server_external_events [req-f54947b7-c63e-4425-a988-ccd3c78816d1 req-0a44a78b-024b-49a2-a37c-55657fb9d0fa service nova] Creating event network-vif-deleted:f99713b4-2587-4880-bc02-eb025501171c for instance ff49fd54-9ddf-415d-8eb4-fb1b0bef634c on hv-cinder-81558 Oct 17 03:57:16.576286 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [req-f54947b7-c63e-4425-a988-ccd3c78816d1 req-0a44a78b-024b-49a2-a37c-55657fb9d0fa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077879 Oct 17 03:57:16.576899 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 258/514] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 03:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:57:16.583199 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-3f86435c-d12b-4d6e-9f5a-49ebde48d013 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:16.584080 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-3f86435c-d12b-4d6e-9f5a-49ebde48d013 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: ff49fd54-9ddf-415d-8eb4-fb1b0bef634c] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:16.591590 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3f86435c-d12b-4d6e-9f5a-49ebde48d013 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:16.592326 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3f86435c-d12b-4d6e-9f5a-49ebde48d013 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:16.592917 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3f86435c-d12b-4d6e-9f5a-49ebde48d013 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:16.593808 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3f86435c-d12b-4d6e-9f5a-49ebde48d013 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:16.594425 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3f86435c-d12b-4d6e-9f5a-49ebde48d013 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:16.595238 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3f86435c-d12b-4d6e-9f5a-49ebde48d013 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:16.611683 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-cedc9a79-ab11-4495-8a98-f4ea5d97076e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:16.620708 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-cedc9a79-ab11-4495-8a98-f4ea5d97076e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:16.622578 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-cedc9a79-ab11-4495-8a98-f4ea5d97076e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:16.624819 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-cedc9a79-ab11-4495-8a98-f4ea5d97076e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1721 microversion: 2.20 time: 0.271198 Oct 17 03:57:16.643337 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 257/515] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:57:16 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1721 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:57:16.676191 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-3f86435c-d12b-4d6e-9f5a-49ebde48d013 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:16.687462 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-3f86435c-d12b-4d6e-9f5a-49ebde48d013 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c" status: 200 len: 1615 microversion: 2.1 time: 0.109020 Oct 17 03:57:16.699206 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 259/516] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:16 2022] GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c => generated 1615 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:16.877532 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-565bb845-7e30-4557-98a2-e5bb705fc3c0 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:16.877891 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-565bb845-7e30-4557-98a2-e5bb705fc3c0 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:16.884057 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-565bb845-7e30-4557-98a2-e5bb705fc3c0 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:16.884814 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-565bb845-7e30-4557-98a2-e5bb705fc3c0 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:16.885470 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-565bb845-7e30-4557-98a2-e5bb705fc3c0 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:16.886181 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-565bb845-7e30-4557-98a2-e5bb705fc3c0 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:16.886663 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-565bb845-7e30-4557-98a2-e5bb705fc3c0 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:16.887131 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-565bb845-7e30-4557-98a2-e5bb705fc3c0 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:17.030373 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-565bb845-7e30-4557-98a2-e5bb705fc3c0 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:17.038638 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-565bb845-7e30-4557-98a2-e5bb705fc3c0 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1678 microversion: 2.1 time: 0.166266 Oct 17 03:57:17.043522 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 258/517] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:16 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:17.268406 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [req-2476f59d-5a7f-4cbd-b980-bd79a39f60e5 req-0d586c58-43da-4f63-b7e8-25f277224bac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0982f171-946d-4314-89f2-c139e6bf9adf", "name": "network-vif-unplugged", "status": "completed", "tag": "8d6b4ea5-ab61-4510-be24-bef55f15afa4"}]} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:57:17.280305 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-2476f59d-5a7f-4cbd-b980-bd79a39f60e5 req-0d586c58-43da-4f63-b7e8-25f277224bac service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:17.285166 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-2476f59d-5a7f-4cbd-b980-bd79a39f60e5 req-0d586c58-43da-4f63-b7e8-25f277224bac service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:17.285166 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-2476f59d-5a7f-4cbd-b980-bd79a39f60e5 req-0d586c58-43da-4f63-b7e8-25f277224bac service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:17.292590 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-8e07988f-7aa8-4d27-b8da-afb129f9f317 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b92cd2b1-85e3-409b-bef1-1d2a0932c463"}} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:57:17.295309 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-8e07988f-7aa8-4d27-b8da-afb129f9f317 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 57546995-2ef9-4773-a47a-13cbd2a831a9] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:17.302158 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8e07988f-7aa8-4d27-b8da-afb129f9f317 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:17.302752 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8e07988f-7aa8-4d27-b8da-afb129f9f317 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:17.304436 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8e07988f-7aa8-4d27-b8da-afb129f9f317 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:17.305478 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8e07988f-7aa8-4d27-b8da-afb129f9f317 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:17.317557 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8e07988f-7aa8-4d27-b8da-afb129f9f317 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:17.318126 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8e07988f-7aa8-4d27-b8da-afb129f9f317 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:17.321606 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.compute.server_external_events [req-2476f59d-5a7f-4cbd-b980-bd79a39f60e5 req-0d586c58-43da-4f63-b7e8-25f277224bac service nova] Creating event network-vif-unplugged:8d6b4ea5-ab61-4510-be24-bef55f15afa4 for instance 0982f171-946d-4314-89f2-c139e6bf9adf on hv-cinder-81558 Oct 17 03:57:17.329034 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [req-2476f59d-5a7f-4cbd-b980-bd79a39f60e5 req-0d586c58-43da-4f63-b7e8-25f277224bac service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064547 Oct 17 03:57:17.330008 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 260/518] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 03:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:57:17.652404 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-b5afcbd3-ae0a-4dc9-a697-1b0e2084cd86 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:17.653105 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-b5afcbd3-ae0a-4dc9-a697-1b0e2084cd86 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:17.659431 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b5afcbd3-ae0a-4dc9-a697-1b0e2084cd86 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:17.659918 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b5afcbd3-ae0a-4dc9-a697-1b0e2084cd86 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:17.660355 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b5afcbd3-ae0a-4dc9-a697-1b0e2084cd86 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:17.661041 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b5afcbd3-ae0a-4dc9-a697-1b0e2084cd86 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:17.661519 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b5afcbd3-ae0a-4dc9-a697-1b0e2084cd86 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:17.661938 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b5afcbd3-ae0a-4dc9-a697-1b0e2084cd86 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:17.792079 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-b5afcbd3-ae0a-4dc9-a697-1b0e2084cd86 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:17.800250 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-b5afcbd3-ae0a-4dc9-a697-1b0e2084cd86 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:17.801697 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-b5afcbd3-ae0a-4dc9-a697-1b0e2084cd86 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:17.802849 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-b5afcbd3-ae0a-4dc9-a697-1b0e2084cd86 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1721 microversion: 2.20 time: 0.155496 Oct 17 03:57:17.803456 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 261/519] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:57:17 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:57:17.809837 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-04670c2c-e600-4f74-9879-ae11c515d433 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:17.810449 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-04670c2c-e600-4f74-9879-ae11c515d433 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: ff49fd54-9ddf-415d-8eb4-fb1b0bef634c] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:17.816191 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-04670c2c-e600-4f74-9879-ae11c515d433 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:17.816678 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-04670c2c-e600-4f74-9879-ae11c515d433 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:17.817114 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-04670c2c-e600-4f74-9879-ae11c515d433 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:17.817807 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-04670c2c-e600-4f74-9879-ae11c515d433 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:17.818259 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-04670c2c-e600-4f74-9879-ae11c515d433 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:17.818685 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-04670c2c-e600-4f74-9879-ae11c515d433 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:17.881375 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-04670c2c-e600-4f74-9879-ae11c515d433 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:17.889377 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-04670c2c-e600-4f74-9879-ae11c515d433 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c" status: 200 len: 1615 microversion: 2.1 time: 0.084768 Oct 17 03:57:17.889871 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 262/520] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:17 2022] GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c => generated 1615 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:18.080532 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [req-715a10b6-a471-4a2e-970d-9faff482e837 req-bf2c4ee2-7584-4056-9246-6867b211daba admin admin] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:18.083953 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-715a10b6-a471-4a2e-970d-9faff482e837 req-bf2c4ee2-7584-4056-9246-6867b211daba admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:18.084432 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-715a10b6-a471-4a2e-970d-9faff482e837 req-bf2c4ee2-7584-4056-9246-6867b211daba admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:18.084868 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-715a10b6-a471-4a2e-970d-9faff482e837 req-bf2c4ee2-7584-4056-9246-6867b211daba admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:18.093391 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-715a10b6-a471-4a2e-970d-9faff482e837 req-bf2c4ee2-7584-4056-9246-6867b211daba admin admin] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:18.093855 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-715a10b6-a471-4a2e-970d-9faff482e837 req-bf2c4ee2-7584-4056-9246-6867b211daba admin admin] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:18.094281 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-715a10b6-a471-4a2e-970d-9faff482e837 req-bf2c4ee2-7584-4056-9246-6867b211daba admin admin] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:18.107562 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [req-715a10b6-a471-4a2e-970d-9faff482e837 req-bf2c4ee2-7584-4056-9246-6867b211daba admin admin] 10.222.0.43 "DELETE /compute/v2.1/os-assisted-volume-snapshots/dfe375c8-a4ff-4163-b163-5550a5cdbb4a?delete_info=%7B%22file_to_merge%22:%20%22volume-6ac06077-c340-4a57-85e2-ff15f90f7662.dfe375c8-a4ff-4163-b163-5550a5cdbb4a.vhdx%22,%20%22volume_id%22:%20%226ac06077-c340-4a57-85e2-ff15f90f7662%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.075482 Oct 17 03:57:18.108131 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 263/521] 10.222.0.43 () {62 vars in 1800 bytes} [Mon Oct 17 03:57:18 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/dfe375c8-a4ff-4163-b163-5550a5cdbb4a?delete_info=%7B%22file_to_merge%22:%20%22volume-6ac06077-c340-4a57-85e2-ff15f90f7662.dfe375c8-a4ff-4163-b163-5550a5cdbb4a.vhdx%22,%20%22volume_id%22:%20%226ac06077-c340-4a57-85e2-ff15f90f7662%22%7D => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 03:57:18.112977 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-9e125f71-6e80-4624-90ae-f00b1bcaae14 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:18.113668 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-9e125f71-6e80-4624-90ae-f00b1bcaae14 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:18.119413 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-9e125f71-6e80-4624-90ae-f00b1bcaae14 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:18.119894 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-9e125f71-6e80-4624-90ae-f00b1bcaae14 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:18.120330 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-9e125f71-6e80-4624-90ae-f00b1bcaae14 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:18.121018 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-9e125f71-6e80-4624-90ae-f00b1bcaae14 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:18.121474 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-9e125f71-6e80-4624-90ae-f00b1bcaae14 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:18.121897 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-9e125f71-6e80-4624-90ae-f00b1bcaae14 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:18.250412 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-9e125f71-6e80-4624-90ae-f00b1bcaae14 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:18.258091 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-9e125f71-6e80-4624-90ae-f00b1bcaae14 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1678 microversion: 2.1 time: 0.148882 Oct 17 03:57:18.258654 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 264/522] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:18 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:18.828357 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-b6a43c24-65f5-4834-b50b-6df38110f8f0 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:18.828973 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-b6a43c24-65f5-4834-b50b-6df38110f8f0 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:18.835481 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b6a43c24-65f5-4834-b50b-6df38110f8f0 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:18.835992 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b6a43c24-65f5-4834-b50b-6df38110f8f0 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:18.836475 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b6a43c24-65f5-4834-b50b-6df38110f8f0 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:18.837144 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b6a43c24-65f5-4834-b50b-6df38110f8f0 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:18.837626 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b6a43c24-65f5-4834-b50b-6df38110f8f0 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:18.838052 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b6a43c24-65f5-4834-b50b-6df38110f8f0 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:18.972150 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-b6a43c24-65f5-4834-b50b-6df38110f8f0 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:18.980689 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-b6a43c24-65f5-4834-b50b-6df38110f8f0 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:18.982169 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-b6a43c24-65f5-4834-b50b-6df38110f8f0 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:18.983382 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-b6a43c24-65f5-4834-b50b-6df38110f8f0 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1721 microversion: 2.20 time: 0.158924 Oct 17 03:57:18.983943 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 265/523] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:57:18 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:57:18.988388 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-43243e46-ea23-4f6e-9bad-1b33d4690696 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:18.989091 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-43243e46-ea23-4f6e-9bad-1b33d4690696 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: ff49fd54-9ddf-415d-8eb4-fb1b0bef634c] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:18.994892 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-43243e46-ea23-4f6e-9bad-1b33d4690696 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:18.995389 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-43243e46-ea23-4f6e-9bad-1b33d4690696 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:18.995826 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-43243e46-ea23-4f6e-9bad-1b33d4690696 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:18.996532 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-43243e46-ea23-4f6e-9bad-1b33d4690696 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:18.996983 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-43243e46-ea23-4f6e-9bad-1b33d4690696 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:18.997409 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-43243e46-ea23-4f6e-9bad-1b33d4690696 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:19.027891 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-43243e46-ea23-4f6e-9bad-1b33d4690696 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:19.028368 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-43243e46-ea23-4f6e-9bad-1b33d4690696 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:19.028804 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-43243e46-ea23-4f6e-9bad-1b33d4690696 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:19.029244 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.objects.instance [None req-43243e46-ea23-4f6e-9bad-1b33d4690696 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lazy-loading 'fault' on Instance uuid ff49fd54-9ddf-415d-8eb4-fb1b0bef634c {{(pid=125871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:57:19.069723 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-43243e46-ea23-4f6e-9bad-1b33d4690696 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:19.077356 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-43243e46-ea23-4f6e-9bad-1b33d4690696 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c" status: 200 len: 1331 microversion: 2.1 time: 0.092469 Oct 17 03:57:19.077917 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 266/524] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:18 2022] GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c => generated 1331 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:19.282458 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-1213a78b-ff82-40e8-89b9-3185f495454e tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:19.283365 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-1213a78b-ff82-40e8-89b9-3185f495454e tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:19.289597 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1213a78b-ff82-40e8-89b9-3185f495454e tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:19.290086 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1213a78b-ff82-40e8-89b9-3185f495454e tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:19.290520 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1213a78b-ff82-40e8-89b9-3185f495454e tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:19.291246 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1213a78b-ff82-40e8-89b9-3185f495454e tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:19.291765 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1213a78b-ff82-40e8-89b9-3185f495454e tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:19.292242 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1213a78b-ff82-40e8-89b9-3185f495454e tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:19.310392 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:57:19.431129 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-1213a78b-ff82-40e8-89b9-3185f495454e tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:19.438673 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-1213a78b-ff82-40e8-89b9-3185f495454e tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1678 microversion: 2.1 time: 0.160338 Oct 17 03:57:19.439283 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 267/525] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:19 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:57:19.801139 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-8e07988f-7aa8-4d27-b8da-afb129f9f317 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "POST /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.512778 Oct 17 03:57:19.801754 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 259/526] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Oct 17 03:57:17 2022] POST /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9/os-volume_attachments => generated 194 bytes in 2514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:57:20.009841 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-f8e8e93d-57fd-4e99-90c0-2d7ce8d094b0 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:20.010494 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-f8e8e93d-57fd-4e99-90c0-2d7ce8d094b0 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:20.017442 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f8e8e93d-57fd-4e99-90c0-2d7ce8d094b0 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:20.017928 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f8e8e93d-57fd-4e99-90c0-2d7ce8d094b0 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:20.018366 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f8e8e93d-57fd-4e99-90c0-2d7ce8d094b0 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:20.019124 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f8e8e93d-57fd-4e99-90c0-2d7ce8d094b0 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:20.019569 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f8e8e93d-57fd-4e99-90c0-2d7ce8d094b0 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:20.019994 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f8e8e93d-57fd-4e99-90c0-2d7ce8d094b0 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:20.101438 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-c0efe57d-b234-403a-b5a5-5cb471bfb2e6 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:20.102245 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-c0efe57d-b234-403a-b5a5-5cb471bfb2e6 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: ff49fd54-9ddf-415d-8eb4-fb1b0bef634c] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:20.111201 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c0efe57d-b234-403a-b5a5-5cb471bfb2e6 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:20.111694 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c0efe57d-b234-403a-b5a5-5cb471bfb2e6 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:20.112133 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c0efe57d-b234-403a-b5a5-5cb471bfb2e6 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:20.113775 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c0efe57d-b234-403a-b5a5-5cb471bfb2e6 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:20.113775 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c0efe57d-b234-403a-b5a5-5cb471bfb2e6 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:20.113987 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c0efe57d-b234-403a-b5a5-5cb471bfb2e6 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:20.151595 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c0efe57d-b234-403a-b5a5-5cb471bfb2e6 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:20.152075 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c0efe57d-b234-403a-b5a5-5cb471bfb2e6 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:20.152506 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c0efe57d-b234-403a-b5a5-5cb471bfb2e6 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:20.153065 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.objects.instance [None req-c0efe57d-b234-403a-b5a5-5cb471bfb2e6 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lazy-loading 'fault' on Instance uuid ff49fd54-9ddf-415d-8eb4-fb1b0bef634c {{(pid=125872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:57:20.164060 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-f8e8e93d-57fd-4e99-90c0-2d7ce8d094b0 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:20.175286 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-f8e8e93d-57fd-4e99-90c0-2d7ce8d094b0 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:20.176868 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-f8e8e93d-57fd-4e99-90c0-2d7ce8d094b0 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:20.178269 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-f8e8e93d-57fd-4e99-90c0-2d7ce8d094b0 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1724 microversion: 2.20 time: 0.172980 Oct 17 03:57:20.178892 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 268/527] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:57:20 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:57:20.201845 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-c0efe57d-b234-403a-b5a5-5cb471bfb2e6 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:20.206533 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-4dacfd6e-5bef-46de-a536-9a98ad21b0e2 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "74c56665-48ac-4d43-a05f-2f42078b1134"}} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:57:20.209022 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-4dacfd6e-5bef-46de-a536-9a98ad21b0e2 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:20.209815 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-c0efe57d-b234-403a-b5a5-5cb471bfb2e6 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c" status: 200 len: 1331 microversion: 2.1 time: 0.112797 Oct 17 03:57:20.210385 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 260/528] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:20 2022] GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c => generated 1331 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:57:20.215240 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-4dacfd6e-5bef-46de-a536-9a98ad21b0e2 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:20.215745 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-4dacfd6e-5bef-46de-a536-9a98ad21b0e2 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:20.216491 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-4dacfd6e-5bef-46de-a536-9a98ad21b0e2 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:20.217321 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-4dacfd6e-5bef-46de-a536-9a98ad21b0e2 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:20.217908 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-4dacfd6e-5bef-46de-a536-9a98ad21b0e2 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:20.218462 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-4dacfd6e-5bef-46de-a536-9a98ad21b0e2 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:20.461856 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-16685c8f-ec9d-4aa3-85eb-11b2e685813e tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:20.462476 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-16685c8f-ec9d-4aa3-85eb-11b2e685813e tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:20.469512 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-16685c8f-ec9d-4aa3-85eb-11b2e685813e tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:20.469992 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-16685c8f-ec9d-4aa3-85eb-11b2e685813e tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:20.470424 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-16685c8f-ec9d-4aa3-85eb-11b2e685813e tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:20.474370 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-16685c8f-ec9d-4aa3-85eb-11b2e685813e tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:20.474370 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-16685c8f-ec9d-4aa3-85eb-11b2e685813e tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:20.474370 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-16685c8f-ec9d-4aa3-85eb-11b2e685813e tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:20.602101 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-16685c8f-ec9d-4aa3-85eb-11b2e685813e tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:20.613113 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-16685c8f-ec9d-4aa3-85eb-11b2e685813e tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1678 microversion: 2.1 time: 0.155078 Oct 17 03:57:20.613967 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 261/529] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:20 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:57:21.233136 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-2e1bd0c2-8e23-4b4a-a23c-9d0940ecaacb tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:21.233867 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-2e1bd0c2-8e23-4b4a-a23c-9d0940ecaacb tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: ff49fd54-9ddf-415d-8eb4-fb1b0bef634c] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:21.240395 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2e1bd0c2-8e23-4b4a-a23c-9d0940ecaacb tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:21.240935 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2e1bd0c2-8e23-4b4a-a23c-9d0940ecaacb tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:21.241567 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2e1bd0c2-8e23-4b4a-a23c-9d0940ecaacb tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:21.242271 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2e1bd0c2-8e23-4b4a-a23c-9d0940ecaacb tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:21.242782 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2e1bd0c2-8e23-4b4a-a23c-9d0940ecaacb tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:21.243293 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2e1bd0c2-8e23-4b4a-a23c-9d0940ecaacb tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:21.261560 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.wsgi [None req-2e1bd0c2-8e23-4b4a-a23c-9d0940ecaacb tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] HTTP exception thrown: Instance ff49fd54-9ddf-415d-8eb4-fb1b0bef634c could not be found. Oct 17 03:57:21.263877 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-2e1bd0c2-8e23-4b4a-a23c-9d0940ecaacb tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Request method failure captured: Oct 17 03:57:21.263877 dv-cinder-815582-16-smb devstack@n-api.service[125872]: request: GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c HTTP/1.1 Oct 17 03:57:21.263877 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Accept: application/json Oct 17 03:57:21.263877 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Accept-Encoding: identity Oct 17 03:57:21.263877 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Connection: close Oct 17 03:57:21.263877 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Content-Length: 0 Oct 17 03:57:21.263877 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Content-Type: application/json Oct 17 03:57:21.263877 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Host: 10.222.0.16 Oct 17 03:57:21.263877 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Openstack-System-Scope: None Oct 17 03:57:21.263877 dv-cinder-815582-16-smb devstack@n-api.service[125872]: User-Agent: python-urllib3/1.26.12 Oct 17 03:57:21.263877 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Auth-Token: gAAAAABjTNHS-JkBpYGlE8smCEkK5jojHou0K6VK_tNmdNYF8mJS0isG5A2O-CJO1Z0ixcowhaVCDpWbdKHf1nvQBjXwKqEHeDqSudyXAc3IKeNiaKgebnu28MS5PTi1Pi3TKRwLiMEjkJOln2AC5NFbphJ0QfPkQ085FD6azHU6IqdftqedhcI Oct 17 03:57:21.263877 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Domain-Id: None Oct 17 03:57:21.263877 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Domain-Name: None Oct 17 03:57:21.263877 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Identity-Status: Confirmed Oct 17 03:57:21.263877 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Is-Admin-Project: True Oct 17 03:57:21.263877 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Domain-Id: default Oct 17 03:57:21.263877 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Domain-Name: Default Oct 17 03:57:21.263877 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Id: 8af3ce80f169473882a247ba78d3d6ef Oct 17 03:57:21.263877 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Name: tempest-AttachVolumeNegativeTest-973579303 Oct 17 03:57:21.263877 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Role: reader,member Oct 17 03:57:21.263877 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Roles: reader,member Oct 17 03:57:21.265528 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8af3ce80f169473882a247ba78d3d6ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8af3ce80f169473882a247ba78d3d6ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8af3ce80f169473882a247ba78d3d6ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8af3ce80f169473882a247ba78d3d6ef", "adminURL": "http://10.222.0.16:8080"}]}] Oct 17 03:57:21.265528 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant: tempest-AttachVolumeNegativeTest-973579303 Oct 17 03:57:21.265528 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant-Id: 8af3ce80f169473882a247ba78d3d6ef Oct 17 03:57:21.265528 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-973579303 Oct 17 03:57:21.265528 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User: tempest-AttachVolumeNegativeTest-973579303-project Oct 17 03:57:21.265528 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Domain-Id: default Oct 17 03:57:21.265528 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Domain-Name: Default Oct 17 03:57:21.265528 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Id: e9ac14bb6ceb4d9a92a20938e9688bbd Oct 17 03:57:21.265528 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Name: tempest-AttachVolumeNegativeTest-973579303-project Oct 17 03:57:21.265528 dv-cinder-815582-16-smb devstack@n-api.service[125872]: method: > Oct 17 03:57:21.265528 dv-cinder-815582-16-smb devstack@n-api.service[125872]: exception: Instance ff49fd54-9ddf-415d-8eb4-fb1b0bef634c could not be found. Oct 17 03:57:21.265528 dv-cinder-815582-16-smb devstack@n-api.service[125872]: action_args: {'id': 'ff49fd54-9ddf-415d-8eb4-fb1b0bef634c'} Oct 17 03:57:21.266406 dv-cinder-815582-16-smb devstack@n-api.service[125872]: {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:57:21.266406 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:57:21.266406 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 03:57:21.266406 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 03:57:21.266406 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 03:57:21.266406 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 03:57:21.266406 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 03:57:21.266406 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 03:57:21.266406 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 03:57:21.266406 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 03:57:21.266406 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff49fd54-9ddf-415d-8eb4-fb1b0bef634c could not be found. Oct 17 03:57:21.266406 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:57:21.266406 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:57:21.266406 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:57:21.266406 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:57:21.266406 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:57:21.266406 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:57:21.266406 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:57:21.266406 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:57:21.266406 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:57:21.267995 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:57:21.267995 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 03:57:21.267995 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 03:57:21.267995 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 03:57:21.267995 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 03:57:21.267995 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 03:57:21.267995 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:57:21.267995 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff49fd54-9ddf-415d-8eb4-fb1b0bef634c could not be found. Oct 17 03:57:21.267995 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:57:21.267995 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:57:21.267995 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:57:21.267995 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:57:21.267995 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:57:21.267995 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:57:21.267995 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:57:21.267995 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:57:21.267995 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff49fd54-9ddf-415d-8eb4-fb1b0bef634c could not be found. Oct 17 03:57:21.267995 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:57:21.270537 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-2e1bd0c2-8e23-4b4a-a23c-9d0940ecaacb tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Returning 404 to user: Instance ff49fd54-9ddf-415d-8eb4-fb1b0bef634c could not be found. {{(pid=125872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:57:21.270537 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-2e1bd0c2-8e23-4b4a-a23c-9d0940ecaacb tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c" status: 404 len: 111 microversion: 2.1 time: 0.036823 Oct 17 03:57:21.270537 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 262/530] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:21 2022] GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 03:57:21.275222 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-4ebba694-2503-4f8f-9aad-c9b9401149f7 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '.version_select at 0x7fd72a5f1160>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:21.386536 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-4dacfd6e-5bef-46de-a536-9a98ad21b0e2 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "POST /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.184041 Oct 17 03:57:21.389549 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 269/531] 10.222.0.16 () {62 vars in 1364 bytes} [Mon Oct 17 03:57:20 2022] POST /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf/os-volume_attachments => generated 188 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 03:57:21.395232 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-4ebba694-2503-4f8f-9aad-c9b9401149f7 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-775223072" status: 202 len: 0 microversion: 2.1 time: 0.119841 Oct 17 03:57:21.395232 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 263/532] 10.222.0.16 () {58 vars in 1218 bytes} [Mon Oct 17 03:57:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-775223072 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 03:57:21.535053 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-544541b1-9b75-46b4-aa83-a35ef0433bac tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:57:21.536072 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-544541b1-9b75-46b4-aa83-a35ef0433bac tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:21.540415 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:57:21.546089 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-544541b1-9b75-46b4-aa83-a35ef0433bac tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:21.546089 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-544541b1-9b75-46b4-aa83-a35ef0433bac tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:21.546089 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-544541b1-9b75-46b4-aa83-a35ef0433bac tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:21.546089 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-544541b1-9b75-46b4-aa83-a35ef0433bac tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:21.546428 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-544541b1-9b75-46b4-aa83-a35ef0433bac tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:21.546825 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-544541b1-9b75-46b4-aa83-a35ef0433bac tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:21.589111 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-544541b1-9b75-46b4-aa83-a35ef0433bac tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=125871) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 17 03:57:21.637980 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-0bd8ea12-a546-4d62-9225-fcf0e91455b1 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:21.638689 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-0bd8ea12-a546-4d62-9225-fcf0e91455b1 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:21.647033 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0bd8ea12-a546-4d62-9225-fcf0e91455b1 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:21.647773 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0bd8ea12-a546-4d62-9225-fcf0e91455b1 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:21.648203 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0bd8ea12-a546-4d62-9225-fcf0e91455b1 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:21.648896 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0bd8ea12-a546-4d62-9225-fcf0e91455b1 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:21.649351 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0bd8ea12-a546-4d62-9225-fcf0e91455b1 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:21.649901 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0bd8ea12-a546-4d62-9225-fcf0e91455b1 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:21.753928 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_cell0:SELECT=4 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:57:21.828014 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-0bd8ea12-a546-4d62-9225-fcf0e91455b1 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:21.836619 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-0bd8ea12-a546-4d62-9225-fcf0e91455b1 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1678 microversion: 2.1 time: 0.203205 Oct 17 03:57:21.837229 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 264/533] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:21 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1678 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:57:22.023357 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-544541b1-9b75-46b4-aa83-a35ef0433bac tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "POST /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf/action" status: 202 len: 0 microversion: 2.20 time: 0.494569 Oct 17 03:57:22.024173 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 270/534] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Oct 17 03:57:21 2022] POST /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf/action => generated 0 bytes in 496 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 03:57:22.032987 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-57d5d766-abcb-4bde-8122-6b731494cfa3 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:22.033854 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-57d5d766-abcb-4bde-8122-6b731494cfa3 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:22.040760 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-57d5d766-abcb-4bde-8122-6b731494cfa3 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:22.042034 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-57d5d766-abcb-4bde-8122-6b731494cfa3 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:22.042452 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-57d5d766-abcb-4bde-8122-6b731494cfa3 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:22.043477 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-57d5d766-abcb-4bde-8122-6b731494cfa3 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:22.043932 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-57d5d766-abcb-4bde-8122-6b731494cfa3 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:22.044350 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-57d5d766-abcb-4bde-8122-6b731494cfa3 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:22.205955 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-57d5d766-abcb-4bde-8122-6b731494cfa3 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:22.227595 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-57d5d766-abcb-4bde-8122-6b731494cfa3 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:22.229062 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-57d5d766-abcb-4bde-8122-6b731494cfa3 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:22.230550 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-57d5d766-abcb-4bde-8122-6b731494cfa3 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1750 microversion: 2.20 time: 0.201514 Oct 17 03:57:22.231119 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 265/535] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:57:22 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1750 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:57:22.367810 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-8f037c2c-7d73-4bb7-ad94-7fb2e1defe65 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Action: 'create', calling method: .version_select at 0x7fd72a6cadc0>, body: {"keypair": {"name": "tempest-keypair-1209713416", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLdhoWrzZPRmaqIVxmoCx7bLdS4wi4inXvnOFXgYMl/3hsMSNEkMQw7etTuTIKu4l8LY2efhBoH7SCplvj6YdWb795UL4245mpGUxWFMkwArIp9qH1ppDjSadzVSsutpuQ=="}} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:57:22.397522 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.quota [None req-8f037c2c-7d73-4bb7-ad94-7fb2e1defe65 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Getting quotas for project 8af3ce80f169473882a247ba78d3d6ef. Resources: {'key_pairs'} {{(pid=125871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 03:57:22.407146 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.quota [None req-8f037c2c-7d73-4bb7-ad94-7fb2e1defe65 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Getting quotas for user e9ac14bb6ceb4d9a92a20938e9688bbd and project 8af3ce80f169473882a247ba78d3d6ef. Resources: {'key_pairs'} {{(pid=125871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 03:57:22.540410 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [req-50c7eee8-9df1-4444-a9e3-878d8bb3acbf req-9c9019c2-49f4-469c-810b-c4f743de01ec admin admin] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:22.541568 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-8f037c2c-7d73-4bb7-ad94-7fb2e1defe65 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.177894 Oct 17 03:57:22.542586 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 271/536] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 17 03:57:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 03:57:22.544121 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-50c7eee8-9df1-4444-a9e3-878d8bb3acbf req-9c9019c2-49f4-469c-810b-c4f743de01ec admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:22.544632 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-50c7eee8-9df1-4444-a9e3-878d8bb3acbf req-9c9019c2-49f4-469c-810b-c4f743de01ec admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:22.545057 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-50c7eee8-9df1-4444-a9e3-878d8bb3acbf req-9c9019c2-49f4-469c-810b-c4f743de01ec admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:22.556206 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-50c7eee8-9df1-4444-a9e3-878d8bb3acbf req-9c9019c2-49f4-469c-810b-c4f743de01ec admin admin] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:22.557216 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-50c7eee8-9df1-4444-a9e3-878d8bb3acbf req-9c9019c2-49f4-469c-810b-c4f743de01ec admin admin] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:22.557657 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-50c7eee8-9df1-4444-a9e3-878d8bb3acbf req-9c9019c2-49f4-469c-810b-c4f743de01ec admin admin] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:22.579440 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [req-50c7eee8-9df1-4444-a9e3-878d8bb3acbf req-9c9019c2-49f4-469c-810b-c4f743de01ec admin admin] 10.222.0.43 "DELETE /compute/v2.1/os-assisted-volume-snapshots/c6127db3-7ac0-45df-9605-b41269986bf8?delete_info=%7B%22file_to_merge%22:%20%22volume-6ac06077-c340-4a57-85e2-ff15f90f7662.c6127db3-7ac0-45df-9605-b41269986bf8.vhdx%22,%20%22volume_id%22:%20%226ac06077-c340-4a57-85e2-ff15f90f7662%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.095787 Oct 17 03:57:22.579440 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 266/537] 10.222.0.43 () {62 vars in 1800 bytes} [Mon Oct 17 03:57:22 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/c6127db3-7ac0-45df-9605-b41269986bf8?delete_info=%7B%22file_to_merge%22:%20%22volume-6ac06077-c340-4a57-85e2-ff15f90f7662.c6127db3-7ac0-45df-9605-b41269986bf8.vhdx%22,%20%22volume_id%22:%20%226ac06077-c340-4a57-85e2-ff15f90f7662%22%7D => generated 0 bytes in 97 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 03:57:22.860750 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-a1c512e6-3512-4928-9cb4-0dd5a330c3e9 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:22.861490 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-a1c512e6-3512-4928-9cb4-0dd5a330c3e9 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:22.868660 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a1c512e6-3512-4928-9cb4-0dd5a330c3e9 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:22.869979 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a1c512e6-3512-4928-9cb4-0dd5a330c3e9 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:22.870429 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a1c512e6-3512-4928-9cb4-0dd5a330c3e9 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:22.871141 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a1c512e6-3512-4928-9cb4-0dd5a330c3e9 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:22.871654 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a1c512e6-3512-4928-9cb4-0dd5a330c3e9 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:22.872053 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a1c512e6-3512-4928-9cb4-0dd5a330c3e9 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:23.052677 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-a1c512e6-3512-4928-9cb4-0dd5a330c3e9 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:23.064008 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-a1c512e6-3512-4928-9cb4-0dd5a330c3e9 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1678 microversion: 2.1 time: 0.207278 Oct 17 03:57:23.071617 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 272/538] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:22 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1678 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:23.189232 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-c02cf94a-8239-4e08-b5e3-a26c79ccc11b tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:57:23.191505 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-c02cf94a-8239-4e08-b5e3-a26c79ccc11b tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 57546995-2ef9-4773-a47a-13cbd2a831a9] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:23.197827 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c02cf94a-8239-4e08-b5e3-a26c79ccc11b tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:23.198313 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c02cf94a-8239-4e08-b5e3-a26c79ccc11b tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:23.198742 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c02cf94a-8239-4e08-b5e3-a26c79ccc11b tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:23.199468 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c02cf94a-8239-4e08-b5e3-a26c79ccc11b tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:23.199919 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c02cf94a-8239-4e08-b5e3-a26c79ccc11b tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:23.200335 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c02cf94a-8239-4e08-b5e3-a26c79ccc11b tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:23.223306 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.objects.instance [None req-c02cf94a-8239-4e08-b5e3-a26c79ccc11b tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lazy-loading 'flavor' on Instance uuid 57546995-2ef9-4773-a47a-13cbd2a831a9 {{(pid=125872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:57:23.256576 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-4bdae941-a75a-407f-969c-8468e0769dfc tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:23.257636 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-4bdae941-a75a-407f-969c-8468e0769dfc tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:23.265433 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-4bdae941-a75a-407f-969c-8468e0769dfc tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:23.266251 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-4bdae941-a75a-407f-969c-8468e0769dfc tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:23.266760 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-4bdae941-a75a-407f-969c-8468e0769dfc tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:23.267798 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-4bdae941-a75a-407f-969c-8468e0769dfc tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:23.268258 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-4bdae941-a75a-407f-969c-8468e0769dfc tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:23.275908 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-4bdae941-a75a-407f-969c-8468e0769dfc tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:23.428708 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-4bdae941-a75a-407f-969c-8468e0769dfc tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:23.435678 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:57:23.438115 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-4bdae941-a75a-407f-969c-8468e0769dfc tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:23.439662 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-4bdae941-a75a-407f-969c-8468e0769dfc tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:23.440957 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-4bdae941-a75a-407f-969c-8468e0769dfc tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1750 microversion: 2.20 time: 0.188971 Oct 17 03:57:23.443388 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 273/539] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:57:23 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1750 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:57:23.643789 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-c02cf94a-8239-4e08-b5e3-a26c79ccc11b tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "POST /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9/action" status: 200 len: 32 microversion: 2.1 time: 0.457388 Oct 17 03:57:23.643789 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 267/540] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 17 03:57:23 2022] POST /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9/action => generated 32 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 03:57:23.652377 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-7049bbbd-d357-4a10-a935-8d373eba6473 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:23.653256 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-7049bbbd-d357-4a10-a935-8d373eba6473 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 57546995-2ef9-4773-a47a-13cbd2a831a9] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:23.659304 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7049bbbd-d357-4a10-a935-8d373eba6473 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:23.659795 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7049bbbd-d357-4a10-a935-8d373eba6473 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:23.660233 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7049bbbd-d357-4a10-a935-8d373eba6473 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:23.660927 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7049bbbd-d357-4a10-a935-8d373eba6473 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:23.661382 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7049bbbd-d357-4a10-a935-8d373eba6473 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:23.661806 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7049bbbd-d357-4a10-a935-8d373eba6473 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:23.814774 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-7049bbbd-d357-4a10-a935-8d373eba6473 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:23.823833 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-7049bbbd-d357-4a10-a935-8d373eba6473 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9" status: 200 len: 1736 microversion: 2.1 time: 0.176033 Oct 17 03:57:23.824413 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 274/541] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:23 2022] GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9 => generated 1736 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:24.091078 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-acd448d1-9917-4880-9dd0-b44db1b06e57 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:24.091846 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-acd448d1-9917-4880-9dd0-b44db1b06e57 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:24.098767 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-acd448d1-9917-4880-9dd0-b44db1b06e57 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:24.099282 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-acd448d1-9917-4880-9dd0-b44db1b06e57 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:24.100678 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-acd448d1-9917-4880-9dd0-b44db1b06e57 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:24.101563 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-acd448d1-9917-4880-9dd0-b44db1b06e57 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:24.102014 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-acd448d1-9917-4880-9dd0-b44db1b06e57 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:24.102592 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-acd448d1-9917-4880-9dd0-b44db1b06e57 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:24.466589 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-0e4a2569-abf8-4b1e-9c17-782a722213f8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:24.467434 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-acd448d1-9917-4880-9dd0-b44db1b06e57 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:24.467605 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-0e4a2569-abf8-4b1e-9c17-782a722213f8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:24.474590 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0e4a2569-abf8-4b1e-9c17-782a722213f8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:24.475416 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0e4a2569-abf8-4b1e-9c17-782a722213f8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:24.475896 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-acd448d1-9917-4880-9dd0-b44db1b06e57 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1678 microversion: 2.1 time: 0.390108 Oct 17 03:57:24.476020 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0e4a2569-abf8-4b1e-9c17-782a722213f8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:24.476484 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 268/542] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:24 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1678 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:24.476816 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0e4a2569-abf8-4b1e-9c17-782a722213f8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:24.477408 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0e4a2569-abf8-4b1e-9c17-782a722213f8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:24.478263 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0e4a2569-abf8-4b1e-9c17-782a722213f8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:24.720959 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-0e4a2569-abf8-4b1e-9c17-782a722213f8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:24.733257 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-0e4a2569-abf8-4b1e-9c17-782a722213f8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:24.733257 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-0e4a2569-abf8-4b1e-9c17-782a722213f8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:24.733574 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-0e4a2569-abf8-4b1e-9c17-782a722213f8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1750 microversion: 2.20 time: 0.270972 Oct 17 03:57:24.734217 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 275/543] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:57:24 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1750 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:57:24.847539 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-a90c2e2d-2d4c-4eb3-a1e5-a9149d5c8640 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:24.848232 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-a90c2e2d-2d4c-4eb3-a1e5-a9149d5c8640 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 57546995-2ef9-4773-a47a-13cbd2a831a9] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:24.854996 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a90c2e2d-2d4c-4eb3-a1e5-a9149d5c8640 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:24.855516 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a90c2e2d-2d4c-4eb3-a1e5-a9149d5c8640 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:24.856018 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a90c2e2d-2d4c-4eb3-a1e5-a9149d5c8640 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:24.859449 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a90c2e2d-2d4c-4eb3-a1e5-a9149d5c8640 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:24.859449 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a90c2e2d-2d4c-4eb3-a1e5-a9149d5c8640 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:24.859449 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a90c2e2d-2d4c-4eb3-a1e5-a9149d5c8640 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:25.047338 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-a90c2e2d-2d4c-4eb3-a1e5-a9149d5c8640 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:25.057532 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-a90c2e2d-2d4c-4eb3-a1e5-a9149d5c8640 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9" status: 200 len: 1736 microversion: 2.1 time: 0.212174 Oct 17 03:57:25.057532 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 269/544] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:24 2022] GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9 => generated 1736 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:57:25.372074 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-f2251d2e-dc38-4ae9-9e3e-e42ce979ea4f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2067654331", "imageRef": "add1979e-0a3b-4403-a8ae-8d9a7b045fc2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "08dcfdbc-aaeb-49ae-86ff-471831242857"}], "security_groups": [{"name": "tempest-securitygroup--314370222"}], "key_name": "tempest-keypair-1209713416", "user_data": "}} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:57:25.447604 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-2402d33b-01c7-4fb4-9ae8-df0bcda487de tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:25.448179 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-2402d33b-01c7-4fb4-9ae8-df0bcda487de tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] [instance: 52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:25.454493 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2402d33b-01c7-4fb4-9ae8-df0bcda487de tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:25.454975 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2402d33b-01c7-4fb4-9ae8-df0bcda487de tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:25.455443 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2402d33b-01c7-4fb4-9ae8-df0bcda487de tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:25.456146 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2402d33b-01c7-4fb4-9ae8-df0bcda487de tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:25.456603 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2402d33b-01c7-4fb4-9ae8-df0bcda487de tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:25.457027 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2402d33b-01c7-4fb4-9ae8-df0bcda487de tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:25.476866 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.network.neutron [None req-f2251d2e-dc38-4ae9-9e3e-e42ce979ea4f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] validate_networks() for [('08dcfdbc-aaeb-49ae-86ff-471831242857', None, None, None, None, None)] {{(pid=125871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 03:57:25.544929 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.objects.instance [None req-2402d33b-01c7-4fb4-9ae8-df0bcda487de tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lazy-loading 'services' on Instance uuid 52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0 {{(pid=125872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:57:25.777719 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-2402d33b-01c7-4fb4-9ae8-df0bcda487de tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] 10.222.0.16 "DELETE /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0/os-volume_attachments/6ac06077-c340-4a57-85e2-ff15f90f7662" status: 202 len: 0 microversion: 2.1 time: 0.333888 Oct 17 03:57:25.778482 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 270/545] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Oct 17 03:57:25 2022] DELETE /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0/os-volume_attachments/6ac06077-c340-4a57-85e2-ff15f90f7662 => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 03:57:25.785237 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-a5772caa-7307-48b8-a56e-fd6748bee5fb tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:25.785968 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-a5772caa-7307-48b8-a56e-fd6748bee5fb tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:25.794180 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a5772caa-7307-48b8-a56e-fd6748bee5fb tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:25.796183 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a5772caa-7307-48b8-a56e-fd6748bee5fb tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:25.796785 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a5772caa-7307-48b8-a56e-fd6748bee5fb tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:25.797683 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a5772caa-7307-48b8-a56e-fd6748bee5fb tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:25.798139 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a5772caa-7307-48b8-a56e-fd6748bee5fb tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:25.803737 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a5772caa-7307-48b8-a56e-fd6748bee5fb tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:25.877606 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.virt.hardware [None req-f2251d2e-dc38-4ae9-9e3e-e42ce979ea4f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Flavor limits 0:0:0 {{(pid=125871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 03:57:25.878100 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.virt.hardware [None req-f2251d2e-dc38-4ae9-9e3e-e42ce979ea4f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Image limits 0:0:0 {{(pid=125871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 03:57:25.878679 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.virt.hardware [None req-f2251d2e-dc38-4ae9-9e3e-e42ce979ea4f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Flavor pref 0:0:0 {{(pid=125871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 03:57:25.879157 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.virt.hardware [None req-f2251d2e-dc38-4ae9-9e3e-e42ce979ea4f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Image pref 0:0:0 {{(pid=125871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 03:57:25.879662 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.virt.hardware [None req-f2251d2e-dc38-4ae9-9e3e-e42ce979ea4f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 03:57:25.889128 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f2251d2e-dc38-4ae9-9e3e-e42ce979ea4f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:25.889727 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f2251d2e-dc38-4ae9-9e3e-e42ce979ea4f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:25.890238 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f2251d2e-dc38-4ae9-9e3e-e42ce979ea4f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:25.892096 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f2251d2e-dc38-4ae9-9e3e-e42ce979ea4f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:25.892679 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f2251d2e-dc38-4ae9-9e3e-e42ce979ea4f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:25.896527 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f2251d2e-dc38-4ae9-9e3e-e42ce979ea4f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:25.911968 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.quota [None req-f2251d2e-dc38-4ae9-9e3e-e42ce979ea4f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Getting quotas for project 8af3ce80f169473882a247ba78d3d6ef. Resources: {'cores', 'instances', 'ram'} {{(pid=125871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 03:57:25.916774 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.quota [None req-f2251d2e-dc38-4ae9-9e3e-e42ce979ea4f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Getting quotas for user e9ac14bb6ceb4d9a92a20938e9688bbd and project 8af3ce80f169473882a247ba78d3d6ef. Resources: {'cores', 'instances', 'ram'} {{(pid=125871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 03:57:25.928771 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-f2251d2e-dc38-4ae9-9e3e-e42ce979ea4f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Going to run 1 instances... {{(pid=125871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 03:57:25.931599 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-f2251d2e-dc38-4ae9-9e3e-e42ce979ea4f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 6dabcc62-4829-4f97-830f-e82af447faca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='add1979e-0a3b-4403-a8ae-8d9a7b045fc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 03:57:25.959825 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-a5772caa-7307-48b8-a56e-fd6748bee5fb tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:25.968759 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-a5772caa-7307-48b8-a56e-fd6748bee5fb tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1655 microversion: 2.1 time: 0.188838 Oct 17 03:57:25.969492 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 271/546] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:25 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1655 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:25.973989 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-98212ede-8bcc-4c19-8722-e0d96bcdcb17 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:25.974596 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-98212ede-8bcc-4c19-8722-e0d96bcdcb17 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:25.980678 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-98212ede-8bcc-4c19-8722-e0d96bcdcb17 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:25.981171 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-98212ede-8bcc-4c19-8722-e0d96bcdcb17 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:25.981607 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-98212ede-8bcc-4c19-8722-e0d96bcdcb17 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:25.982338 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-98212ede-8bcc-4c19-8722-e0d96bcdcb17 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:25.982791 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-98212ede-8bcc-4c19-8722-e0d96bcdcb17 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:25.983234 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-98212ede-8bcc-4c19-8722-e0d96bcdcb17 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:26.082890 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-f2251d2e-dc38-4ae9-9e3e-e42ce979ea4f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.715959 Oct 17 03:57:26.086654 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 276/547] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 17 03:57:25 2022] POST /compute/v2.1/servers => generated 401 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 03:57:26.090084 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-a6348ff1-615d-4b02-9a6a-5ed71e8cfe27 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:57:26.096235 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a6348ff1-615d-4b02-9a6a-5ed71e8cfe27 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:26.096727 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a6348ff1-615d-4b02-9a6a-5ed71e8cfe27 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:26.097169 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a6348ff1-615d-4b02-9a6a-5ed71e8cfe27 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:26.119963 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-a6348ff1-615d-4b02-9a6a-5ed71e8cfe27 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Going to try to start instance {{(pid=125871) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 17 03:57:26.126879 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-98212ede-8bcc-4c19-8722-e0d96bcdcb17 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:26.137478 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-98212ede-8bcc-4c19-8722-e0d96bcdcb17 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:26.139392 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-98212ede-8bcc-4c19-8722-e0d96bcdcb17 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:26.140756 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-98212ede-8bcc-4c19-8722-e0d96bcdcb17 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1808 microversion: 2.20 time: 0.170504 Oct 17 03:57:26.144257 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 272/548] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:57:25 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:57:26.151442 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-970b82d8-36d0-44be-a5cf-8f95c5c49dcd tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:26.152402 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-970b82d8-36d0-44be-a5cf-8f95c5c49dcd tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 57546995-2ef9-4773-a47a-13cbd2a831a9] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:26.159071 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-970b82d8-36d0-44be-a5cf-8f95c5c49dcd tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:26.159663 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-970b82d8-36d0-44be-a5cf-8f95c5c49dcd tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:26.160165 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-970b82d8-36d0-44be-a5cf-8f95c5c49dcd tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:26.160863 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-970b82d8-36d0-44be-a5cf-8f95c5c49dcd tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:26.161300 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-970b82d8-36d0-44be-a5cf-8f95c5c49dcd tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:26.161761 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-970b82d8-36d0-44be-a5cf-8f95c5c49dcd tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:26.297355 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-970b82d8-36d0-44be-a5cf-8f95c5c49dcd tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:26.300883 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-a6348ff1-615d-4b02-9a6a-5ed71e8cfe27 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "POST /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe/action" status: 202 len: 0 microversion: 2.1 time: 0.215748 Oct 17 03:57:26.301900 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 277/549] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 17 03:57:26 2022] POST /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 03:57:26.308917 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-970b82d8-36d0-44be-a5cf-8f95c5c49dcd tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9" status: 200 len: 1736 microversion: 2.1 time: 0.163054 Oct 17 03:57:26.319310 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-d01f7300-951f-48f3-b661-17a0e01cf2ca tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:26.319685 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 273/550] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:26 2022] GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:26.320766 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-d01f7300-951f-48f3-b661-17a0e01cf2ca tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 6dabcc62-4829-4f97-830f-e82af447faca] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:26.324156 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-479c4157-eac2-455b-9182-9c808e0c1ab2 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:26.324775 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-479c4157-eac2-455b-9182-9c808e0c1ab2 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:26.331287 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-479c4157-eac2-455b-9182-9c808e0c1ab2 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:26.340426 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-479c4157-eac2-455b-9182-9c808e0c1ab2 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:26.340426 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-479c4157-eac2-455b-9182-9c808e0c1ab2 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:26.340426 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-479c4157-eac2-455b-9182-9c808e0c1ab2 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:26.340426 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-479c4157-eac2-455b-9182-9c808e0c1ab2 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:26.340854 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-479c4157-eac2-455b-9182-9c808e0c1ab2 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:26.376210 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-d01f7300-951f-48f3-b661-17a0e01cf2ca tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:26.384738 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-d01f7300-951f-48f3-b661-17a0e01cf2ca tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca" status: 200 len: 1242 microversion: 2.1 time: 0.081119 Oct 17 03:57:26.386264 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 278/551] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:26 2022] GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca => generated 1242 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:26.481048 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-479c4157-eac2-455b-9182-9c808e0c1ab2 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:26.489241 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-479c4157-eac2-455b-9182-9c808e0c1ab2 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1664 microversion: 2.1 time: 0.178258 Oct 17 03:57:26.489943 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 274/552] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:26 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1664 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:26.934755 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-280d6d23-df68-4e75-8445-2400e3a3a1fa tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:26.935382 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-280d6d23-df68-4e75-8445-2400e3a3a1fa tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] [instance: 52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:26.942615 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-280d6d23-df68-4e75-8445-2400e3a3a1fa tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:26.943108 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-280d6d23-df68-4e75-8445-2400e3a3a1fa tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:26.943568 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-280d6d23-df68-4e75-8445-2400e3a3a1fa tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:26.944265 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-280d6d23-df68-4e75-8445-2400e3a3a1fa tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:26.944718 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-280d6d23-df68-4e75-8445-2400e3a3a1fa tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:26.945143 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-280d6d23-df68-4e75-8445-2400e3a3a1fa tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:26.972260 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-280d6d23-df68-4e75-8445-2400e3a3a1fa tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] [instance: 52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0] Going to try to terminate instance {{(pid=125871) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 03:57:27.168903 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-b0fe2389-c3fb-426f-adfe-c11417d771fe tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:27.169529 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-b0fe2389-c3fb-426f-adfe-c11417d771fe tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:27.175737 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b0fe2389-c3fb-426f-adfe-c11417d771fe tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:27.176220 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b0fe2389-c3fb-426f-adfe-c11417d771fe tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:27.176655 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b0fe2389-c3fb-426f-adfe-c11417d771fe tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:27.177492 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b0fe2389-c3fb-426f-adfe-c11417d771fe tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:27.177887 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b0fe2389-c3fb-426f-adfe-c11417d771fe tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:27.178312 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b0fe2389-c3fb-426f-adfe-c11417d771fe tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:27.300164 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-280d6d23-df68-4e75-8445-2400e3a3a1fa tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] 10.222.0.16 "DELETE /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0" status: 204 len: 0 microversion: 2.1 time: 0.369609 Oct 17 03:57:27.301293 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 279/553] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 17 03:57:26 2022] DELETE /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 03:57:27.310941 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-b7181a1e-14ef-453b-a9de-e6e802ab8523 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:27.311936 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-b7181a1e-14ef-453b-a9de-e6e802ab8523 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] [instance: 52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:27.323401 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b7181a1e-14ef-453b-a9de-e6e802ab8523 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:27.323401 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b7181a1e-14ef-453b-a9de-e6e802ab8523 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:27.323401 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b7181a1e-14ef-453b-a9de-e6e802ab8523 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:27.323401 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b7181a1e-14ef-453b-a9de-e6e802ab8523 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:27.323787 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b7181a1e-14ef-453b-a9de-e6e802ab8523 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:27.336117 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b7181a1e-14ef-453b-a9de-e6e802ab8523 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:27.348916 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-b0fe2389-c3fb-426f-adfe-c11417d771fe tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:27.357087 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=6,nova_cell1:UPDATE=7 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:57:27.361479 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-b0fe2389-c3fb-426f-adfe-c11417d771fe tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:27.363020 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-b0fe2389-c3fb-426f-adfe-c11417d771fe tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:27.367989 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-b0fe2389-c3fb-426f-adfe-c11417d771fe tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1808 microversion: 2.20 time: 0.200047 Oct 17 03:57:27.367989 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 275/554] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:57:27 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1808 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:57:27.369576 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-d2e595be-1481-48f5-9fe0-2c42ace5d8e3 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:27.370279 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-d2e595be-1481-48f5-9fe0-2c42ace5d8e3 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 57546995-2ef9-4773-a47a-13cbd2a831a9] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:27.376953 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d2e595be-1481-48f5-9fe0-2c42ace5d8e3 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:27.377707 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d2e595be-1481-48f5-9fe0-2c42ace5d8e3 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:27.378365 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d2e595be-1481-48f5-9fe0-2c42ace5d8e3 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:27.379381 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d2e595be-1481-48f5-9fe0-2c42ace5d8e3 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:27.380051 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d2e595be-1481-48f5-9fe0-2c42ace5d8e3 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:27.380689 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d2e595be-1481-48f5-9fe0-2c42ace5d8e3 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:27.481376 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-b7181a1e-14ef-453b-a9de-e6e802ab8523 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ffc76632a456d9e833381783d4dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed59353a4741cbb901808f7d2210d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:27.489133 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-b7181a1e-14ef-453b-a9de-e6e802ab8523 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] 10.222.0.16 "GET /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0" status: 200 len: 1513 microversion: 2.1 time: 0.183078 Oct 17 03:57:27.489705 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 280/555] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:27 2022] GET /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0 => generated 1513 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:57:27.499407 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-95f30b3b-8ecb-4386-a37b-8f5a9fb99fda tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:27.500234 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-95f30b3b-8ecb-4386-a37b-8f5a9fb99fda tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 6dabcc62-4829-4f97-830f-e82af447faca] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:27.506645 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-95f30b3b-8ecb-4386-a37b-8f5a9fb99fda tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:27.507165 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-95f30b3b-8ecb-4386-a37b-8f5a9fb99fda tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:27.507701 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-95f30b3b-8ecb-4386-a37b-8f5a9fb99fda tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:27.508426 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-95f30b3b-8ecb-4386-a37b-8f5a9fb99fda tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:27.508880 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-95f30b3b-8ecb-4386-a37b-8f5a9fb99fda tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:27.510105 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-95f30b3b-8ecb-4386-a37b-8f5a9fb99fda tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:27.517737 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-d2e595be-1481-48f5-9fe0-2c42ace5d8e3 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:27.526695 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-d2e595be-1481-48f5-9fe0-2c42ace5d8e3 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9" status: 200 len: 1736 microversion: 2.1 time: 0.160752 Oct 17 03:57:27.527281 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 276/556] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:27 2022] GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:27.539193 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-c7208aed-7970-4334-b553-f34720ea7e81 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:27.539860 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-c7208aed-7970-4334-b553-f34720ea7e81 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:27.545996 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c7208aed-7970-4334-b553-f34720ea7e81 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:27.546508 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c7208aed-7970-4334-b553-f34720ea7e81 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:27.549027 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c7208aed-7970-4334-b553-f34720ea7e81 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:27.549027 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c7208aed-7970-4334-b553-f34720ea7e81 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:27.549027 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c7208aed-7970-4334-b553-f34720ea7e81 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:27.549027 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c7208aed-7970-4334-b553-f34720ea7e81 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:27.574131 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-95f30b3b-8ecb-4386-a37b-8f5a9fb99fda tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:27.581910 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-95f30b3b-8ecb-4386-a37b-8f5a9fb99fda tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca" status: 200 len: 1238 microversion: 2.1 time: 0.086344 Oct 17 03:57:27.583272 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 281/557] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:27 2022] GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca => generated 1238 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:27.676271 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-c7208aed-7970-4334-b553-f34720ea7e81 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:27.683929 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-c7208aed-7970-4334-b553-f34720ea7e81 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1664 microversion: 2.1 time: 0.148600 Oct 17 03:57:27.684491 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 277/558] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:27 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1664 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:28.392071 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-2e422740-9968-44a0-a62d-5935e3951526 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:28.392722 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-2e422740-9968-44a0-a62d-5935e3951526 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:28.399054 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2e422740-9968-44a0-a62d-5935e3951526 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:28.399560 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2e422740-9968-44a0-a62d-5935e3951526 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:28.399993 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2e422740-9968-44a0-a62d-5935e3951526 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:28.401333 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2e422740-9968-44a0-a62d-5935e3951526 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:28.401782 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2e422740-9968-44a0-a62d-5935e3951526 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:28.402203 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2e422740-9968-44a0-a62d-5935e3951526 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:28.512834 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-1ab74ccf-5b59-43d3-b6e3-1b920e85aced tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:28.514043 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-1ab74ccf-5b59-43d3-b6e3-1b920e85aced tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] [instance: 52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:28.520387 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1ab74ccf-5b59-43d3-b6e3-1b920e85aced tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:28.520870 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1ab74ccf-5b59-43d3-b6e3-1b920e85aced tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:28.521315 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1ab74ccf-5b59-43d3-b6e3-1b920e85aced tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:28.522084 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1ab74ccf-5b59-43d3-b6e3-1b920e85aced tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:28.522535 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1ab74ccf-5b59-43d3-b6e3-1b920e85aced tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:28.522955 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1ab74ccf-5b59-43d3-b6e3-1b920e85aced tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:28.531743 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-2e422740-9968-44a0-a62d-5935e3951526 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:28.540557 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-2e422740-9968-44a0-a62d-5935e3951526 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:28.542476 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-2e422740-9968-44a0-a62d-5935e3951526 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:28.543759 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-2e422740-9968-44a0-a62d-5935e3951526 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1808 microversion: 2.20 time: 0.155562 Oct 17 03:57:28.544788 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 282/559] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:57:28 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:57:28.549546 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-39184840-1d9c-425b-8417-476959b331c3 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:28.550146 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-39184840-1d9c-425b-8417-476959b331c3 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 57546995-2ef9-4773-a47a-13cbd2a831a9] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:28.556045 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-39184840-1d9c-425b-8417-476959b331c3 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:28.557114 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-39184840-1d9c-425b-8417-476959b331c3 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:28.557613 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-39184840-1d9c-425b-8417-476959b331c3 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:28.558303 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-39184840-1d9c-425b-8417-476959b331c3 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:28.558751 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-39184840-1d9c-425b-8417-476959b331c3 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:28.559200 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-39184840-1d9c-425b-8417-476959b331c3 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:28.661238 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-1ab74ccf-5b59-43d3-b6e3-1b920e85aced tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ffc76632a456d9e833381783d4dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed59353a4741cbb901808f7d2210d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:28.669155 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-1ab74ccf-5b59-43d3-b6e3-1b920e85aced tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] 10.222.0.16 "GET /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0" status: 200 len: 1513 microversion: 2.1 time: 0.160968 Oct 17 03:57:28.669732 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 278/560] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:28 2022] GET /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0 => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:57:28.674136 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-fd46fcc3-c477-4f8d-972c-06d0b5068a9f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:28.674741 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-fd46fcc3-c477-4f8d-972c-06d0b5068a9f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 6dabcc62-4829-4f97-830f-e82af447faca] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:28.680764 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-fd46fcc3-c477-4f8d-972c-06d0b5068a9f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:28.682019 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-fd46fcc3-c477-4f8d-972c-06d0b5068a9f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:28.682515 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-fd46fcc3-c477-4f8d-972c-06d0b5068a9f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:28.683299 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-fd46fcc3-c477-4f8d-972c-06d0b5068a9f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:28.683808 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-fd46fcc3-c477-4f8d-972c-06d0b5068a9f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:28.684296 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-fd46fcc3-c477-4f8d-972c-06d0b5068a9f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:28.691561 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-39184840-1d9c-425b-8417-476959b331c3 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:28.700369 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-39184840-1d9c-425b-8417-476959b331c3 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9" status: 200 len: 1736 microversion: 2.1 time: 0.154371 Oct 17 03:57:28.702211 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 283/561] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:28 2022] GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:28.707564 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-b0e5a67d-7369-4471-b68e-5cc2933f8f64 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:28.708311 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-b0e5a67d-7369-4471-b68e-5cc2933f8f64 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:28.714102 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b0e5a67d-7369-4471-b68e-5cc2933f8f64 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:28.714592 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b0e5a67d-7369-4471-b68e-5cc2933f8f64 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:28.715026 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b0e5a67d-7369-4471-b68e-5cc2933f8f64 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:28.715749 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b0e5a67d-7369-4471-b68e-5cc2933f8f64 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:28.716210 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b0e5a67d-7369-4471-b68e-5cc2933f8f64 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:28.716638 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b0e5a67d-7369-4471-b68e-5cc2933f8f64 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:28.750211 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-fd46fcc3-c477-4f8d-972c-06d0b5068a9f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:28.757895 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-fd46fcc3-c477-4f8d-972c-06d0b5068a9f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca" status: 200 len: 1238 microversion: 2.1 time: 0.087156 Oct 17 03:57:28.758985 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 279/562] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:28 2022] GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca => generated 1238 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:28.843942 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-b0e5a67d-7369-4471-b68e-5cc2933f8f64 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:28.851544 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-b0e5a67d-7369-4471-b68e-5cc2933f8f64 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1664 microversion: 2.1 time: 0.147521 Oct 17 03:57:28.852111 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 284/563] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:28 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1664 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:29.569627 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-28c50795-8583-4633-9403-7fc61f0c6fd1 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:29.570272 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-28c50795-8583-4633-9403-7fc61f0c6fd1 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:29.576792 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-28c50795-8583-4633-9403-7fc61f0c6fd1 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:29.577275 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-28c50795-8583-4633-9403-7fc61f0c6fd1 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:29.579691 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-28c50795-8583-4633-9403-7fc61f0c6fd1 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:29.579691 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-28c50795-8583-4633-9403-7fc61f0c6fd1 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:29.579691 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-28c50795-8583-4633-9403-7fc61f0c6fd1 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:29.579691 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-28c50795-8583-4633-9403-7fc61f0c6fd1 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:29.694645 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-e7099758-0ff6-4f05-9dfd-3e1d39de5c4c tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:29.695274 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-e7099758-0ff6-4f05-9dfd-3e1d39de5c4c tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] [instance: 52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:29.702008 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e7099758-0ff6-4f05-9dfd-3e1d39de5c4c tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:29.702481 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e7099758-0ff6-4f05-9dfd-3e1d39de5c4c tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:29.702911 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e7099758-0ff6-4f05-9dfd-3e1d39de5c4c tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:29.703620 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e7099758-0ff6-4f05-9dfd-3e1d39de5c4c tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:29.704216 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e7099758-0ff6-4f05-9dfd-3e1d39de5c4c tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:29.704539 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e7099758-0ff6-4f05-9dfd-3e1d39de5c4c tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:29.706900 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-28c50795-8583-4633-9403-7fc61f0c6fd1 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:29.716363 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-28c50795-8583-4633-9403-7fc61f0c6fd1 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:29.718041 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-28c50795-8583-4633-9403-7fc61f0c6fd1 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:29.719326 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-28c50795-8583-4633-9403-7fc61f0c6fd1 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1808 microversion: 2.20 time: 0.153653 Oct 17 03:57:29.719952 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 280/564] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:57:29 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:57:29.724256 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-2c47f95b-eae9-4391-b7b5-ed52c59a7105 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:29.725349 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-2c47f95b-eae9-4391-b7b5-ed52c59a7105 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 57546995-2ef9-4773-a47a-13cbd2a831a9] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:29.731133 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2c47f95b-eae9-4391-b7b5-ed52c59a7105 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:29.731652 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2c47f95b-eae9-4391-b7b5-ed52c59a7105 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:29.732235 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2c47f95b-eae9-4391-b7b5-ed52c59a7105 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:29.732929 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2c47f95b-eae9-4391-b7b5-ed52c59a7105 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:29.733379 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2c47f95b-eae9-4391-b7b5-ed52c59a7105 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:29.733802 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2c47f95b-eae9-4391-b7b5-ed52c59a7105 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:29.840785 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-e7099758-0ff6-4f05-9dfd-3e1d39de5c4c tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ffc76632a456d9e833381783d4dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed59353a4741cbb901808f7d2210d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:29.848399 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-e7099758-0ff6-4f05-9dfd-3e1d39de5c4c tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] 10.222.0.16 "GET /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0" status: 200 len: 1513 microversion: 2.1 time: 0.157598 Oct 17 03:57:29.848965 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 285/565] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:29 2022] GET /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:57:29.853946 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-40f6087e-d360-4e25-9787-04b2f1b62f81 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:29.854710 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-40f6087e-d360-4e25-9787-04b2f1b62f81 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 6dabcc62-4829-4f97-830f-e82af447faca] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:29.860741 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-40f6087e-d360-4e25-9787-04b2f1b62f81 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:29.861220 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-40f6087e-d360-4e25-9787-04b2f1b62f81 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:29.861648 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-40f6087e-d360-4e25-9787-04b2f1b62f81 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:29.862335 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-40f6087e-d360-4e25-9787-04b2f1b62f81 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:29.862586 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-2c47f95b-eae9-4391-b7b5-ed52c59a7105 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:29.862782 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-40f6087e-d360-4e25-9787-04b2f1b62f81 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:29.863219 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-40f6087e-d360-4e25-9787-04b2f1b62f81 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:29.871829 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-2c47f95b-eae9-4391-b7b5-ed52c59a7105 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9" status: 200 len: 1736 microversion: 2.1 time: 0.150909 Oct 17 03:57:29.872536 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 281/566] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:29 2022] GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:29.877014 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-eff4fc50-c993-4206-9c7d-c8e25a129ee0 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:29.877611 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-eff4fc50-c993-4206-9c7d-c8e25a129ee0 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:29.883457 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-eff4fc50-c993-4206-9c7d-c8e25a129ee0 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:29.883935 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-eff4fc50-c993-4206-9c7d-c8e25a129ee0 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:29.884684 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-eff4fc50-c993-4206-9c7d-c8e25a129ee0 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:29.885531 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-eff4fc50-c993-4206-9c7d-c8e25a129ee0 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:29.885992 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-eff4fc50-c993-4206-9c7d-c8e25a129ee0 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:29.886410 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-eff4fc50-c993-4206-9c7d-c8e25a129ee0 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:29.923745 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-40f6087e-d360-4e25-9787-04b2f1b62f81 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:29.931333 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-40f6087e-d360-4e25-9787-04b2f1b62f81 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca" status: 200 len: 1238 microversion: 2.1 time: 0.081371 Oct 17 03:57:29.932579 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 286/567] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:29 2022] GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca => generated 1238 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:30.017898 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-eff4fc50-c993-4206-9c7d-c8e25a129ee0 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:30.025467 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-eff4fc50-c993-4206-9c7d-c8e25a129ee0 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1664 microversion: 2.1 time: 0.151943 Oct 17 03:57:30.026025 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 282/568] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:29 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1664 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:30.745373 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-35056eb5-1e2b-4025-a217-6e2822207096 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:30.746041 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-35056eb5-1e2b-4025-a217-6e2822207096 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:30.752652 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-35056eb5-1e2b-4025-a217-6e2822207096 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:30.753138 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-35056eb5-1e2b-4025-a217-6e2822207096 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:30.753574 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-35056eb5-1e2b-4025-a217-6e2822207096 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:30.754272 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-35056eb5-1e2b-4025-a217-6e2822207096 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:30.754729 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-35056eb5-1e2b-4025-a217-6e2822207096 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:30.755149 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-35056eb5-1e2b-4025-a217-6e2822207096 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:30.872285 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-dc2debb7-f507-4f51-be65-23edd83338d2 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:30.872901 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-dc2debb7-f507-4f51-be65-23edd83338d2 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] [instance: 52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:30.879413 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-dc2debb7-f507-4f51-be65-23edd83338d2 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:30.879917 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-dc2debb7-f507-4f51-be65-23edd83338d2 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:30.880307 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-dc2debb7-f507-4f51-be65-23edd83338d2 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:30.880998 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-dc2debb7-f507-4f51-be65-23edd83338d2 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:30.881448 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-dc2debb7-f507-4f51-be65-23edd83338d2 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:30.881872 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-dc2debb7-f507-4f51-be65-23edd83338d2 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:30.882108 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-35056eb5-1e2b-4025-a217-6e2822207096 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:30.893209 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-35056eb5-1e2b-4025-a217-6e2822207096 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:30.894702 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-35056eb5-1e2b-4025-a217-6e2822207096 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:30.895896 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-35056eb5-1e2b-4025-a217-6e2822207096 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1808 microversion: 2.20 time: 0.154506 Oct 17 03:57:30.896451 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 287/569] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:57:30 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:57:30.901145 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:57:30.902302 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-7ed1739e-546b-4c4b-94d9-8e2f17af69cf tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:30.902910 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-7ed1739e-546b-4c4b-94d9-8e2f17af69cf tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 57546995-2ef9-4773-a47a-13cbd2a831a9] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:30.908978 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7ed1739e-546b-4c4b-94d9-8e2f17af69cf tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:30.910024 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7ed1739e-546b-4c4b-94d9-8e2f17af69cf tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:30.910024 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7ed1739e-546b-4c4b-94d9-8e2f17af69cf tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:30.910578 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7ed1739e-546b-4c4b-94d9-8e2f17af69cf tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:30.911027 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7ed1739e-546b-4c4b-94d9-8e2f17af69cf tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:30.911478 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7ed1739e-546b-4c4b-94d9-8e2f17af69cf tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:31.017028 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-dc2debb7-f507-4f51-be65-23edd83338d2 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ffc76632a456d9e833381783d4dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed59353a4741cbb901808f7d2210d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:31.024807 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-dc2debb7-f507-4f51-be65-23edd83338d2 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] 10.222.0.16 "GET /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0" status: 200 len: 1513 microversion: 2.1 time: 0.156791 Oct 17 03:57:31.025420 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 283/570] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:30 2022] GET /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:57:31.029867 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-dc6f7882-beef-496f-84ab-060c5922712a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:31.030475 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-dc6f7882-beef-496f-84ab-060c5922712a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 6dabcc62-4829-4f97-830f-e82af447faca] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:31.036226 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-dc6f7882-beef-496f-84ab-060c5922712a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:31.036895 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-dc6f7882-beef-496f-84ab-060c5922712a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:31.037332 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-dc6f7882-beef-496f-84ab-060c5922712a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:31.038019 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-dc6f7882-beef-496f-84ab-060c5922712a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:31.038656 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-dc6f7882-beef-496f-84ab-060c5922712a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:31.039085 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-dc6f7882-beef-496f-84ab-060c5922712a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:31.044088 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-7ed1739e-546b-4c4b-94d9-8e2f17af69cf tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:31.052325 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-7ed1739e-546b-4c4b-94d9-8e2f17af69cf tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9" status: 200 len: 1736 microversion: 2.1 time: 0.154939 Oct 17 03:57:31.052896 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 288/571] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:30 2022] GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:31.060308 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-c7eb593a-6a99-4cf2-9f07-0e3071674bef tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:31.061048 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-c7eb593a-6a99-4cf2-9f07-0e3071674bef tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:31.066976 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c7eb593a-6a99-4cf2-9f07-0e3071674bef tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:31.067606 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c7eb593a-6a99-4cf2-9f07-0e3071674bef tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:31.068137 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c7eb593a-6a99-4cf2-9f07-0e3071674bef tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:31.068932 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c7eb593a-6a99-4cf2-9f07-0e3071674bef tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:31.069386 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c7eb593a-6a99-4cf2-9f07-0e3071674bef tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:31.069815 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c7eb593a-6a99-4cf2-9f07-0e3071674bef tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:31.103326 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-dc6f7882-beef-496f-84ab-060c5922712a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:31.110902 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-dc6f7882-beef-496f-84ab-060c5922712a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca" status: 200 len: 1238 microversion: 2.1 time: 0.084514 Oct 17 03:57:31.111600 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 284/572] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:31 2022] GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca => generated 1238 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:31.197641 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-c7eb593a-6a99-4cf2-9f07-0e3071674bef tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:31.205203 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-c7eb593a-6a99-4cf2-9f07-0e3071674bef tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1664 microversion: 2.1 time: 0.149926 Oct 17 03:57:31.205795 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 289/573] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:31 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1664 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:31.922999 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-b858c830-880a-409f-83cb-7a8c43c6e870 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:31.923755 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-b858c830-880a-409f-83cb-7a8c43c6e870 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:31.931097 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b858c830-880a-409f-83cb-7a8c43c6e870 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:31.931097 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b858c830-880a-409f-83cb-7a8c43c6e870 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:31.932071 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b858c830-880a-409f-83cb-7a8c43c6e870 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:31.932619 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b858c830-880a-409f-83cb-7a8c43c6e870 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:31.933088 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b858c830-880a-409f-83cb-7a8c43c6e870 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:31.933514 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b858c830-880a-409f-83cb-7a8c43c6e870 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:32.048761 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-11b69a75-a3d5-467d-8d5c-8ba0cecc2753 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:32.049381 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-11b69a75-a3d5-467d-8d5c-8ba0cecc2753 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] [instance: 52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:32.061140 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-11b69a75-a3d5-467d-8d5c-8ba0cecc2753 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:32.062189 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-11b69a75-a3d5-467d-8d5c-8ba0cecc2753 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:32.063012 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-11b69a75-a3d5-467d-8d5c-8ba0cecc2753 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:32.064046 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-11b69a75-a3d5-467d-8d5c-8ba0cecc2753 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:32.064706 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-11b69a75-a3d5-467d-8d5c-8ba0cecc2753 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:32.065332 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-11b69a75-a3d5-467d-8d5c-8ba0cecc2753 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:32.075788 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-b858c830-880a-409f-83cb-7a8c43c6e870 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:32.084909 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-b858c830-880a-409f-83cb-7a8c43c6e870 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:32.087828 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-b858c830-880a-409f-83cb-7a8c43c6e870 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:32.089055 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-b858c830-880a-409f-83cb-7a8c43c6e870 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1808 microversion: 2.20 time: 0.170091 Oct 17 03:57:32.089651 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 285/574] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:57:31 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:57:32.094784 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-d3ae3904-951c-40ad-8a5f-fc84a95eefe3 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:32.095690 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-d3ae3904-951c-40ad-8a5f-fc84a95eefe3 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 57546995-2ef9-4773-a47a-13cbd2a831a9] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:32.102655 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d3ae3904-951c-40ad-8a5f-fc84a95eefe3 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:32.104246 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d3ae3904-951c-40ad-8a5f-fc84a95eefe3 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:32.104854 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d3ae3904-951c-40ad-8a5f-fc84a95eefe3 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:32.105591 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d3ae3904-951c-40ad-8a5f-fc84a95eefe3 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:32.106052 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d3ae3904-951c-40ad-8a5f-fc84a95eefe3 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:32.106528 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d3ae3904-951c-40ad-8a5f-fc84a95eefe3 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:32.251650 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-d3ae3904-951c-40ad-8a5f-fc84a95eefe3 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:32.260563 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-d3ae3904-951c-40ad-8a5f-fc84a95eefe3 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9" status: 200 len: 1736 microversion: 2.1 time: 0.169552 Oct 17 03:57:32.261147 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 286/575] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:32 2022] GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:32.265798 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-d1f3cd23-df31-4445-890c-ec4e05dcf01a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:32.266332 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-d1f3cd23-df31-4445-890c-ec4e05dcf01a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 6dabcc62-4829-4f97-830f-e82af447faca] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:32.269668 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=2 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:57:32.273041 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d1f3cd23-df31-4445-890c-ec4e05dcf01a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:32.273530 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d1f3cd23-df31-4445-890c-ec4e05dcf01a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:32.273961 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d1f3cd23-df31-4445-890c-ec4e05dcf01a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:32.274717 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d1f3cd23-df31-4445-890c-ec4e05dcf01a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:32.276038 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d1f3cd23-df31-4445-890c-ec4e05dcf01a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:32.276628 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d1f3cd23-df31-4445-890c-ec4e05dcf01a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:32.358574 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-d1f3cd23-df31-4445-890c-ec4e05dcf01a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:32.366544 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-d1f3cd23-df31-4445-890c-ec4e05dcf01a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca" status: 200 len: 1294 microversion: 2.1 time: 0.104352 Oct 17 03:57:32.367511 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 287/576] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:32 2022] GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca => generated 1294 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:32.372500 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-800683dc-f050-4596-89b1-ab5aa48b4a19 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:32.373315 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-800683dc-f050-4596-89b1-ab5aa48b4a19 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:32.380600 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-800683dc-f050-4596-89b1-ab5aa48b4a19 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:32.381096 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-800683dc-f050-4596-89b1-ab5aa48b4a19 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:32.381536 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-800683dc-f050-4596-89b1-ab5aa48b4a19 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:32.382309 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-800683dc-f050-4596-89b1-ab5aa48b4a19 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:32.382772 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-800683dc-f050-4596-89b1-ab5aa48b4a19 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:32.383290 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-800683dc-f050-4596-89b1-ab5aa48b4a19 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:32.519806 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-11b69a75-a3d5-467d-8d5c-8ba0cecc2753 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ffc76632a456d9e833381783d4dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed59353a4741cbb901808f7d2210d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:32.532723 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-800683dc-f050-4596-89b1-ab5aa48b4a19 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:32.532889 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-11b69a75-a3d5-467d-8d5c-8ba0cecc2753 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] 10.222.0.16 "GET /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0" status: 200 len: 1513 microversion: 2.1 time: 0.483481 Oct 17 03:57:32.532889 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 290/577] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:32 2022] GET /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0 => generated 1513 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:57:32.534758 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-800683dc-f050-4596-89b1-ab5aa48b4a19 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1664 microversion: 2.1 time: 0.165874 Oct 17 03:57:32.535348 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 288/578] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:32 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1664 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:33.120726 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-e55aa52a-b0cc-4450-9975-6b0490799f5c tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:33.122772 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-e55aa52a-b0cc-4450-9975-6b0490799f5c tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:33.130906 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e55aa52a-b0cc-4450-9975-6b0490799f5c tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:33.131450 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e55aa52a-b0cc-4450-9975-6b0490799f5c tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:33.134482 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e55aa52a-b0cc-4450-9975-6b0490799f5c tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:33.134482 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e55aa52a-b0cc-4450-9975-6b0490799f5c tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:33.134482 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e55aa52a-b0cc-4450-9975-6b0490799f5c tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:33.134482 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e55aa52a-b0cc-4450-9975-6b0490799f5c tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:33.288036 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-5f80a658-6685-4e69-b315-5245a97f127c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:33.289252 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-5f80a658-6685-4e69-b315-5245a97f127c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 57546995-2ef9-4773-a47a-13cbd2a831a9] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:33.291841 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_cell0:SELECT=2 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:57:33.299161 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-5f80a658-6685-4e69-b315-5245a97f127c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:33.299763 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-5f80a658-6685-4e69-b315-5245a97f127c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:33.300428 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-5f80a658-6685-4e69-b315-5245a97f127c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:33.301641 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-5f80a658-6685-4e69-b315-5245a97f127c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:33.302306 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-5f80a658-6685-4e69-b315-5245a97f127c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:33.302900 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-5f80a658-6685-4e69-b315-5245a97f127c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:33.357667 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-e55aa52a-b0cc-4450-9975-6b0490799f5c tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:33.357667 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-e55aa52a-b0cc-4450-9975-6b0490799f5c tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:33.358888 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-e55aa52a-b0cc-4450-9975-6b0490799f5c tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:33.360220 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-e55aa52a-b0cc-4450-9975-6b0490799f5c tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1808 microversion: 2.20 time: 0.243895 Oct 17 03:57:33.361092 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 291/579] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:57:33 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1808 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:57:33.390599 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-e4419077-8927-4214-9975-c347a7ea0e1b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:33.391264 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-e4419077-8927-4214-9975-c347a7ea0e1b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 6dabcc62-4829-4f97-830f-e82af447faca] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:33.397287 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e4419077-8927-4214-9975-c347a7ea0e1b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:33.397960 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e4419077-8927-4214-9975-c347a7ea0e1b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:33.398405 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e4419077-8927-4214-9975-c347a7ea0e1b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:33.399330 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e4419077-8927-4214-9975-c347a7ea0e1b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:33.399789 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e4419077-8927-4214-9975-c347a7ea0e1b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:33.400435 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e4419077-8927-4214-9975-c347a7ea0e1b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:33.461985 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-5f80a658-6685-4e69-b315-5245a97f127c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:33.467740 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-e4419077-8927-4214-9975-c347a7ea0e1b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:33.477769 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-e4419077-8927-4214-9975-c347a7ea0e1b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca" status: 200 len: 1294 microversion: 2.1 time: 0.091158 Oct 17 03:57:33.478943 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 292/580] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:33 2022] GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca => generated 1294 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:57:33.487403 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-5f80a658-6685-4e69-b315-5245a97f127c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9" status: 200 len: 1736 microversion: 2.1 time: 0.205259 Oct 17 03:57:33.498075 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 289/581] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:33 2022] GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9 => generated 1736 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:33.552116 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-977e0309-aa0d-49ab-a5d9-57339eb05783 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:33.553121 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-977e0309-aa0d-49ab-a5d9-57339eb05783 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] [instance: 52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:33.563080 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-33e2ec44-743d-4e5b-b08e-24e11e494e13 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:33.563801 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-33e2ec44-743d-4e5b-b08e-24e11e494e13 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:33.564278 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-977e0309-aa0d-49ab-a5d9-57339eb05783 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:33.565992 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-977e0309-aa0d-49ab-a5d9-57339eb05783 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:33.567598 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-977e0309-aa0d-49ab-a5d9-57339eb05783 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:33.568486 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-977e0309-aa0d-49ab-a5d9-57339eb05783 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:33.572286 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-977e0309-aa0d-49ab-a5d9-57339eb05783 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:33.573050 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-977e0309-aa0d-49ab-a5d9-57339eb05783 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:33.580621 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-33e2ec44-743d-4e5b-b08e-24e11e494e13 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:33.582234 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-33e2ec44-743d-4e5b-b08e-24e11e494e13 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:33.583445 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-33e2ec44-743d-4e5b-b08e-24e11e494e13 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:33.585925 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-33e2ec44-743d-4e5b-b08e-24e11e494e13 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:33.586955 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-33e2ec44-743d-4e5b-b08e-24e11e494e13 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:33.588206 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-33e2ec44-743d-4e5b-b08e-24e11e494e13 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:33.734470 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-977e0309-aa0d-49ab-a5d9-57339eb05783 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ffc76632a456d9e833381783d4dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed59353a4741cbb901808f7d2210d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:33.734470 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-977e0309-aa0d-49ab-a5d9-57339eb05783 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] 10.222.0.16 "GET /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0" status: 200 len: 1471 microversion: 2.1 time: 0.145302 Oct 17 03:57:33.734470 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 293/582] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:33 2022] GET /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0 => generated 1471 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:33.734470 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [req-5a355faa-3077-4352-8ed3-e829283ed4cf req-fa4a2b62-1987-4660-968d-3cc184601752 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0", "name": "network-vif-deleted", "tag": "5d26d1e1-f05b-4c0a-9fb4-366627caaf10"}]} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:57:33.735015 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-5a355faa-3077-4352-8ed3-e829283ed4cf req-fa4a2b62-1987-4660-968d-3cc184601752 service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:33.735015 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-5a355faa-3077-4352-8ed3-e829283ed4cf req-fa4a2b62-1987-4660-968d-3cc184601752 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:33.735015 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-5a355faa-3077-4352-8ed3-e829283ed4cf req-fa4a2b62-1987-4660-968d-3cc184601752 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:33.735015 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.compute.server_external_events [req-5a355faa-3077-4352-8ed3-e829283ed4cf req-fa4a2b62-1987-4660-968d-3cc184601752 service nova] Creating event network-vif-deleted:5d26d1e1-f05b-4c0a-9fb4-366627caaf10 for instance 52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0 on hv-cinder-81558 Oct 17 03:57:33.735015 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [req-5a355faa-3077-4352-8ed3-e829283ed4cf req-fa4a2b62-1987-4660-968d-3cc184601752 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030962 Oct 17 03:57:33.735610 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 294/583] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 03:57:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:57:33.824018 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-33e2ec44-743d-4e5b-b08e-24e11e494e13 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:33.836592 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-33e2ec44-743d-4e5b-b08e-24e11e494e13 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1668 microversion: 2.1 time: 0.282300 Oct 17 03:57:33.847417 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 290/584] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:33 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1668 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:57:34.387893 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-386cf2f6-458f-4772-b2b3-ae0ac00e4aff tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:34.388599 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-386cf2f6-458f-4772-b2b3-ae0ac00e4aff tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:34.394788 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-386cf2f6-458f-4772-b2b3-ae0ac00e4aff tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:34.395310 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-386cf2f6-458f-4772-b2b3-ae0ac00e4aff tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:34.395743 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-386cf2f6-458f-4772-b2b3-ae0ac00e4aff tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:34.396437 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-386cf2f6-458f-4772-b2b3-ae0ac00e4aff tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:34.397698 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-386cf2f6-458f-4772-b2b3-ae0ac00e4aff tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:34.398297 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-386cf2f6-458f-4772-b2b3-ae0ac00e4aff tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:34.507567 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-8897d853-f5ba-4dd4-9a6f-beaf622275d6 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:34.510742 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-8897d853-f5ba-4dd4-9a6f-beaf622275d6 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 6dabcc62-4829-4f97-830f-e82af447faca] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:34.519981 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8897d853-f5ba-4dd4-9a6f-beaf622275d6 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:34.520952 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8897d853-f5ba-4dd4-9a6f-beaf622275d6 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:34.521556 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8897d853-f5ba-4dd4-9a6f-beaf622275d6 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:34.523504 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8897d853-f5ba-4dd4-9a6f-beaf622275d6 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:34.524131 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8897d853-f5ba-4dd4-9a6f-beaf622275d6 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:34.526350 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8897d853-f5ba-4dd4-9a6f-beaf622275d6 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:34.546882 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-386cf2f6-458f-4772-b2b3-ae0ac00e4aff tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:34.557492 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-386cf2f6-458f-4772-b2b3-ae0ac00e4aff tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:34.559308 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-386cf2f6-458f-4772-b2b3-ae0ac00e4aff tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:34.560749 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-386cf2f6-458f-4772-b2b3-ae0ac00e4aff tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1808 microversion: 2.20 time: 0.178604 Oct 17 03:57:34.561532 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 295/585] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:57:34 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:57:34.577651 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-c8bddc7b-6b77-4199-8434-6e552edce8bc tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:34.578617 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-c8bddc7b-6b77-4199-8434-6e552edce8bc tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 57546995-2ef9-4773-a47a-13cbd2a831a9] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:34.585052 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c8bddc7b-6b77-4199-8434-6e552edce8bc tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:34.585629 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c8bddc7b-6b77-4199-8434-6e552edce8bc tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:34.586137 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c8bddc7b-6b77-4199-8434-6e552edce8bc tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:34.586922 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c8bddc7b-6b77-4199-8434-6e552edce8bc tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:34.587500 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c8bddc7b-6b77-4199-8434-6e552edce8bc tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:34.588258 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c8bddc7b-6b77-4199-8434-6e552edce8bc tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:34.614668 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-8897d853-f5ba-4dd4-9a6f-beaf622275d6 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:34.624175 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-8897d853-f5ba-4dd4-9a6f-beaf622275d6 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca" status: 200 len: 1302 microversion: 2.1 time: 0.122421 Oct 17 03:57:34.626226 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 291/586] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:34 2022] GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca => generated 1302 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:57:34.728119 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-c8bddc7b-6b77-4199-8434-6e552edce8bc tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:34.736934 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-c8bddc7b-6b77-4199-8434-6e552edce8bc tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9" status: 200 len: 1736 microversion: 2.1 time: 0.174236 Oct 17 03:57:34.737514 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 296/587] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:34 2022] GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9 => generated 1736 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:34.749310 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-65cc3ca5-0e8a-457e-aa58-c82b6c992769 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:34.749923 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-65cc3ca5-0e8a-457e-aa58-c82b6c992769 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] [instance: 52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:34.760500 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-65cc3ca5-0e8a-457e-aa58-c82b6c992769 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:34.760988 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-65cc3ca5-0e8a-457e-aa58-c82b6c992769 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:34.761415 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-65cc3ca5-0e8a-457e-aa58-c82b6c992769 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:34.762150 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-65cc3ca5-0e8a-457e-aa58-c82b6c992769 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:34.762600 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-65cc3ca5-0e8a-457e-aa58-c82b6c992769 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:34.763017 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-65cc3ca5-0e8a-457e-aa58-c82b6c992769 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:34.827797 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-65cc3ca5-0e8a-457e-aa58-c82b6c992769 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ffc76632a456d9e833381783d4dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed59353a4741cbb901808f7d2210d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:34.835908 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-65cc3ca5-0e8a-457e-aa58-c82b6c992769 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] 10.222.0.16 "GET /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0" status: 200 len: 1303 microversion: 2.1 time: 0.091778 Oct 17 03:57:34.836691 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 292/588] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:34 2022] GET /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0 => generated 1303 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:35.589172 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-cc965ef9-424a-4c07-8c9a-cc9299554ecf tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:35.589789 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-cc965ef9-424a-4c07-8c9a-cc9299554ecf tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:35.596408 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-cc965ef9-424a-4c07-8c9a-cc9299554ecf tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:35.597411 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-cc965ef9-424a-4c07-8c9a-cc9299554ecf tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:35.597411 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-cc965ef9-424a-4c07-8c9a-cc9299554ecf tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:35.597984 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-cc965ef9-424a-4c07-8c9a-cc9299554ecf tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:35.598434 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-cc965ef9-424a-4c07-8c9a-cc9299554ecf tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:35.598852 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-cc965ef9-424a-4c07-8c9a-cc9299554ecf tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:35.653297 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-1d99d763-3d7f-4ed5-b555-4ff1d6bc3ebc tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:35.654062 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-1d99d763-3d7f-4ed5-b555-4ff1d6bc3ebc tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 6dabcc62-4829-4f97-830f-e82af447faca] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:35.665412 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1d99d763-3d7f-4ed5-b555-4ff1d6bc3ebc tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:35.667866 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1d99d763-3d7f-4ed5-b555-4ff1d6bc3ebc tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:35.668345 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1d99d763-3d7f-4ed5-b555-4ff1d6bc3ebc tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:35.669873 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1d99d763-3d7f-4ed5-b555-4ff1d6bc3ebc tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:35.670410 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1d99d763-3d7f-4ed5-b555-4ff1d6bc3ebc tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:35.671204 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1d99d763-3d7f-4ed5-b555-4ff1d6bc3ebc tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:35.763712 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-1d99d763-3d7f-4ed5-b555-4ff1d6bc3ebc tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:35.766239 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-cc965ef9-424a-4c07-8c9a-cc9299554ecf tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:35.769810 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_cell1:SELECT=100 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:57:35.774477 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-1d99d763-3d7f-4ed5-b555-4ff1d6bc3ebc tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca" status: 200 len: 1302 microversion: 2.1 time: 0.123016 Oct 17 03:57:35.774685 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 293/589] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:35 2022] GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca => generated 1302 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:57:35.780152 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-db479ee0-4ac1-4aa4-a112-d97f4ae0af3a tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:35.780778 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-db479ee0-4ac1-4aa4-a112-d97f4ae0af3a tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 57546995-2ef9-4773-a47a-13cbd2a831a9] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:35.787050 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-db479ee0-4ac1-4aa4-a112-d97f4ae0af3a tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:35.787580 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-db479ee0-4ac1-4aa4-a112-d97f4ae0af3a tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:35.788100 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-db479ee0-4ac1-4aa4-a112-d97f4ae0af3a tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:35.789001 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-db479ee0-4ac1-4aa4-a112-d97f4ae0af3a tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:35.789570 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-cc965ef9-424a-4c07-8c9a-cc9299554ecf tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:35.789806 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-db479ee0-4ac1-4aa4-a112-d97f4ae0af3a tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:35.790388 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-db479ee0-4ac1-4aa4-a112-d97f4ae0af3a tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:35.793193 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-cc965ef9-424a-4c07-8c9a-cc9299554ecf tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:35.794484 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-cc965ef9-424a-4c07-8c9a-cc9299554ecf tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1808 microversion: 2.20 time: 0.209382 Oct 17 03:57:35.795487 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 297/590] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:57:35 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1808 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:57:35.860093 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-9f81326d-5c9b-4b0a-8343-9f8967bd2446 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:35.860629 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-9f81326d-5c9b-4b0a-8343-9f8967bd2446 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] [instance: 52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:35.867089 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-9f81326d-5c9b-4b0a-8343-9f8967bd2446 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:35.867630 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-9f81326d-5c9b-4b0a-8343-9f8967bd2446 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:35.868071 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-9f81326d-5c9b-4b0a-8343-9f8967bd2446 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:35.869364 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-9f81326d-5c9b-4b0a-8343-9f8967bd2446 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:35.870003 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-9f81326d-5c9b-4b0a-8343-9f8967bd2446 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:35.870439 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-9f81326d-5c9b-4b0a-8343-9f8967bd2446 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:35.900629 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_cell0:SELECT=4 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:57:35.943832 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-db479ee0-4ac1-4aa4-a112-d97f4ae0af3a tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:35.951317 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-9f81326d-5c9b-4b0a-8343-9f8967bd2446 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ffc76632a456d9e833381783d4dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed59353a4741cbb901808f7d2210d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:35.962649 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-9f81326d-5c9b-4b0a-8343-9f8967bd2446 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] 10.222.0.16 "GET /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0" status: 200 len: 1303 microversion: 2.1 time: 0.106582 Oct 17 03:57:35.962887 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-db479ee0-4ac1-4aa4-a112-d97f4ae0af3a tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9" status: 200 len: 1736 microversion: 2.1 time: 0.186718 Oct 17 03:57:35.963649 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 294/591] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:35 2022] GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9 => generated 1736 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:35.978751 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 298/592] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:35 2022] GET /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0 => generated 1303 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:57:36.799719 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-e5c732cb-f497-4665-8f87-72589beb5f8f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:36.800735 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-e5c732cb-f497-4665-8f87-72589beb5f8f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 6dabcc62-4829-4f97-830f-e82af447faca] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:36.807940 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e5c732cb-f497-4665-8f87-72589beb5f8f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:36.808444 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e5c732cb-f497-4665-8f87-72589beb5f8f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:36.808889 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e5c732cb-f497-4665-8f87-72589beb5f8f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:36.809613 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e5c732cb-f497-4665-8f87-72589beb5f8f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:36.810069 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e5c732cb-f497-4665-8f87-72589beb5f8f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:36.810503 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e5c732cb-f497-4665-8f87-72589beb5f8f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:36.822593 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-d55bcde9-9e08-4131-84f9-5ab0852fc162 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:36.823830 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-d55bcde9-9e08-4131-84f9-5ab0852fc162 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:36.829431 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_cell0:SELECT=12 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:57:36.832763 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d55bcde9-9e08-4131-84f9-5ab0852fc162 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:36.833444 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d55bcde9-9e08-4131-84f9-5ab0852fc162 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:36.833839 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d55bcde9-9e08-4131-84f9-5ab0852fc162 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:36.834373 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d55bcde9-9e08-4131-84f9-5ab0852fc162 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:36.834912 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d55bcde9-9e08-4131-84f9-5ab0852fc162 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:36.835270 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d55bcde9-9e08-4131-84f9-5ab0852fc162 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:36.913353 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-e5c732cb-f497-4665-8f87-72589beb5f8f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:36.915138 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-e5c732cb-f497-4665-8f87-72589beb5f8f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca" status: 200 len: 1302 microversion: 2.1 time: 0.119426 Oct 17 03:57:36.915978 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 295/593] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:36 2022] GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca => generated 1302 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:36.986258 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-a1a45820-d504-4f7f-bb2c-a053a91b3879 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:36.986877 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-a1a45820-d504-4f7f-bb2c-a053a91b3879 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] [instance: 52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:36.993082 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a1a45820-d504-4f7f-bb2c-a053a91b3879 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:36.994075 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a1a45820-d504-4f7f-bb2c-a053a91b3879 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:36.994518 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a1a45820-d504-4f7f-bb2c-a053a91b3879 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:36.995294 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a1a45820-d504-4f7f-bb2c-a053a91b3879 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:36.995755 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a1a45820-d504-4f7f-bb2c-a053a91b3879 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:36.996160 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-d55bcde9-9e08-4131-84f9-5ab0852fc162 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:36.996337 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a1a45820-d504-4f7f-bb2c-a053a91b3879 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:37.007009 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-d55bcde9-9e08-4131-84f9-5ab0852fc162 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:37.008589 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-d55bcde9-9e08-4131-84f9-5ab0852fc162 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:37.010858 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-d55bcde9-9e08-4131-84f9-5ab0852fc162 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1808 microversion: 2.20 time: 0.194155 Oct 17 03:57:37.027827 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 299/594] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:57:36 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1808 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:57:37.055513 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-08c63bc5-1718-4279-a8d3-8cdbb3d7ac3e tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:37.057137 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-08c63bc5-1718-4279-a8d3-8cdbb3d7ac3e tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 57546995-2ef9-4773-a47a-13cbd2a831a9] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:37.063560 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:57:37.065386 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-08c63bc5-1718-4279-a8d3-8cdbb3d7ac3e tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:37.065962 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-08c63bc5-1718-4279-a8d3-8cdbb3d7ac3e tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:37.066472 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-08c63bc5-1718-4279-a8d3-8cdbb3d7ac3e tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:37.067315 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-08c63bc5-1718-4279-a8d3-8cdbb3d7ac3e tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:37.067850 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-08c63bc5-1718-4279-a8d3-8cdbb3d7ac3e tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:37.068402 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-08c63bc5-1718-4279-a8d3-8cdbb3d7ac3e tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:37.086410 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-a1a45820-d504-4f7f-bb2c-a053a91b3879 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ffc76632a456d9e833381783d4dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed59353a4741cbb901808f7d2210d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:37.097298 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-a1a45820-d504-4f7f-bb2c-a053a91b3879 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] 10.222.0.16 "GET /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0" status: 200 len: 1303 microversion: 2.1 time: 0.114871 Oct 17 03:57:37.098203 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 296/595] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:36 2022] GET /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0 => generated 1303 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:37.236698 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-08c63bc5-1718-4279-a8d3-8cdbb3d7ac3e tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:37.245250 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-08c63bc5-1718-4279-a8d3-8cdbb3d7ac3e tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9" status: 200 len: 1736 microversion: 2.1 time: 0.215762 Oct 17 03:57:37.246045 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 300/596] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:37 2022] GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9 => generated 1736 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:37.943201 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-c973511f-b851-405d-87f2-eff4114d5a62 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:37.943819 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-c973511f-b851-405d-87f2-eff4114d5a62 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 6dabcc62-4829-4f97-830f-e82af447faca] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:37.950219 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c973511f-b851-405d-87f2-eff4114d5a62 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:37.950701 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c973511f-b851-405d-87f2-eff4114d5a62 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:37.951352 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c973511f-b851-405d-87f2-eff4114d5a62 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:37.952044 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c973511f-b851-405d-87f2-eff4114d5a62 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:37.952501 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c973511f-b851-405d-87f2-eff4114d5a62 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:37.952920 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c973511f-b851-405d-87f2-eff4114d5a62 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:38.023832 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-c973511f-b851-405d-87f2-eff4114d5a62 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:38.037524 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-c973511f-b851-405d-87f2-eff4114d5a62 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca" status: 200 len: 1302 microversion: 2.1 time: 0.095693 Oct 17 03:57:38.038145 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 297/597] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:37 2022] GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca => generated 1302 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:38.058670 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-d8a7951d-c47c-4d17-9318-1654f61d0f26 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:38.060006 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-d8a7951d-c47c-4d17-9318-1654f61d0f26 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:38.066867 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d8a7951d-c47c-4d17-9318-1654f61d0f26 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:38.067624 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d8a7951d-c47c-4d17-9318-1654f61d0f26 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:38.068053 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d8a7951d-c47c-4d17-9318-1654f61d0f26 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:38.068796 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d8a7951d-c47c-4d17-9318-1654f61d0f26 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:38.069204 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d8a7951d-c47c-4d17-9318-1654f61d0f26 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:38.069627 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d8a7951d-c47c-4d17-9318-1654f61d0f26 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:38.121329 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-0263f65d-ea2f-45de-b458-96fd64be462c tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:38.122368 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-0263f65d-ea2f-45de-b458-96fd64be462c tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] [instance: 52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:38.129781 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0263f65d-ea2f-45de-b458-96fd64be462c tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:38.130895 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0263f65d-ea2f-45de-b458-96fd64be462c tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:38.131673 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0263f65d-ea2f-45de-b458-96fd64be462c tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:38.132596 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0263f65d-ea2f-45de-b458-96fd64be462c tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:38.133210 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0263f65d-ea2f-45de-b458-96fd64be462c tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:38.133805 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0263f65d-ea2f-45de-b458-96fd64be462c tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:38.219558 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-0263f65d-ea2f-45de-b458-96fd64be462c tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ffc76632a456d9e833381783d4dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed59353a4741cbb901808f7d2210d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:38.222800 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-d8a7951d-c47c-4d17-9318-1654f61d0f26 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:38.230520 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-0263f65d-ea2f-45de-b458-96fd64be462c tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] 10.222.0.16 "GET /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0" status: 200 len: 1303 microversion: 2.1 time: 0.113894 Oct 17 03:57:38.231338 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 298/598] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:38 2022] GET /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0 => generated 1303 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:57:38.232432 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-d8a7951d-c47c-4d17-9318-1654f61d0f26 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:38.233896 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-d8a7951d-c47c-4d17-9318-1654f61d0f26 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:38.235063 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-d8a7951d-c47c-4d17-9318-1654f61d0f26 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1808 microversion: 2.20 time: 0.180954 Oct 17 03:57:38.247426 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 301/599] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:57:38 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:57:38.272820 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-5e323c62-059a-4be6-852c-a1b9e5b5b31e tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:38.273433 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-5e323c62-059a-4be6-852c-a1b9e5b5b31e tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 57546995-2ef9-4773-a47a-13cbd2a831a9] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:38.279590 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-5e323c62-059a-4be6-852c-a1b9e5b5b31e tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:38.280075 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-5e323c62-059a-4be6-852c-a1b9e5b5b31e tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:38.280510 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-5e323c62-059a-4be6-852c-a1b9e5b5b31e tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:38.281720 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-5e323c62-059a-4be6-852c-a1b9e5b5b31e tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:38.282181 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-5e323c62-059a-4be6-852c-a1b9e5b5b31e tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:38.282605 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-5e323c62-059a-4be6-852c-a1b9e5b5b31e tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:38.426674 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-5e323c62-059a-4be6-852c-a1b9e5b5b31e tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:38.434972 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-5e323c62-059a-4be6-852c-a1b9e5b5b31e tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9" status: 200 len: 1736 microversion: 2.1 time: 0.165950 Oct 17 03:57:38.435751 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 299/600] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:38 2022] GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:39.061503 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-7b0d311b-c596-4ab4-b57a-8ad1030d74fa tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:39.062166 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-7b0d311b-c596-4ab4-b57a-8ad1030d74fa tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 6dabcc62-4829-4f97-830f-e82af447faca] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:39.068530 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7b0d311b-c596-4ab4-b57a-8ad1030d74fa tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:39.074995 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7b0d311b-c596-4ab4-b57a-8ad1030d74fa tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:39.074995 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7b0d311b-c596-4ab4-b57a-8ad1030d74fa tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:39.074995 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7b0d311b-c596-4ab4-b57a-8ad1030d74fa tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:39.074995 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7b0d311b-c596-4ab4-b57a-8ad1030d74fa tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:39.075459 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7b0d311b-c596-4ab4-b57a-8ad1030d74fa tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:39.142168 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-7b0d311b-c596-4ab4-b57a-8ad1030d74fa tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:39.150831 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-7b0d311b-c596-4ab4-b57a-8ad1030d74fa tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca" status: 200 len: 1302 microversion: 2.1 time: 0.093206 Oct 17 03:57:39.151446 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 302/601] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:39 2022] GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca => generated 1302 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:39.254447 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-88c39fdb-a369-46d6-a660-6292eeb32eee tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:39.255074 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-88c39fdb-a369-46d6-a660-6292eeb32eee tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] [instance: 52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:39.261998 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-77544a09-8c48-4b23-a9c9-947d5e4891f7 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:39.262771 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-77544a09-8c48-4b23-a9c9-947d5e4891f7 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:39.262967 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-88c39fdb-a369-46d6-a660-6292eeb32eee tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:39.263496 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-88c39fdb-a369-46d6-a660-6292eeb32eee tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:39.263913 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-88c39fdb-a369-46d6-a660-6292eeb32eee tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:39.264615 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-88c39fdb-a369-46d6-a660-6292eeb32eee tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:39.265063 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-88c39fdb-a369-46d6-a660-6292eeb32eee tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:39.265614 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-88c39fdb-a369-46d6-a660-6292eeb32eee tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:39.269384 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-77544a09-8c48-4b23-a9c9-947d5e4891f7 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:39.269885 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-77544a09-8c48-4b23-a9c9-947d5e4891f7 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:39.270302 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-77544a09-8c48-4b23-a9c9-947d5e4891f7 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:39.271009 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-77544a09-8c48-4b23-a9c9-947d5e4891f7 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:39.271154 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_cell1:SELECT=100 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:57:39.271496 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-77544a09-8c48-4b23-a9c9-947d5e4891f7 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:39.272060 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-77544a09-8c48-4b23-a9c9-947d5e4891f7 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:39.338643 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-88c39fdb-a369-46d6-a660-6292eeb32eee tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ffc76632a456d9e833381783d4dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed59353a4741cbb901808f7d2210d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:39.347541 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-88c39fdb-a369-46d6-a660-6292eeb32eee tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] 10.222.0.16 "GET /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0" status: 200 len: 1303 microversion: 2.1 time: 0.096993 Oct 17 03:57:39.352454 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 300/602] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:39 2022] GET /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0 => generated 1303 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:39.415967 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-77544a09-8c48-4b23-a9c9-947d5e4891f7 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:39.426767 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-77544a09-8c48-4b23-a9c9-947d5e4891f7 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:39.428280 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-77544a09-8c48-4b23-a9c9-947d5e4891f7 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:39.429459 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-77544a09-8c48-4b23-a9c9-947d5e4891f7 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1808 microversion: 2.20 time: 0.171603 Oct 17 03:57:39.430030 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 303/603] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:57:39 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:57:39.457871 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-ad645dcb-4b66-4a51-8fdb-315d5ad9162c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:39.458492 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-ad645dcb-4b66-4a51-8fdb-315d5ad9162c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 57546995-2ef9-4773-a47a-13cbd2a831a9] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:39.465103 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ad645dcb-4b66-4a51-8fdb-315d5ad9162c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:39.465596 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ad645dcb-4b66-4a51-8fdb-315d5ad9162c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:39.466038 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ad645dcb-4b66-4a51-8fdb-315d5ad9162c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:39.466750 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ad645dcb-4b66-4a51-8fdb-315d5ad9162c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:39.467240 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ad645dcb-4b66-4a51-8fdb-315d5ad9162c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:39.474946 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ad645dcb-4b66-4a51-8fdb-315d5ad9162c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:39.620206 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-ad645dcb-4b66-4a51-8fdb-315d5ad9162c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:39.628730 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-ad645dcb-4b66-4a51-8fdb-315d5ad9162c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9" status: 200 len: 1736 microversion: 2.1 time: 0.174675 Oct 17 03:57:39.629526 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 301/604] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:39 2022] GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9 => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:40.173943 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-7b969ecb-2d6f-4647-9aa6-aa3a91142f71 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:40.175379 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-7b969ecb-2d6f-4647-9aa6-aa3a91142f71 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 6dabcc62-4829-4f97-830f-e82af447faca] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:40.182001 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7b969ecb-2d6f-4647-9aa6-aa3a91142f71 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:40.182845 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7b969ecb-2d6f-4647-9aa6-aa3a91142f71 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:40.183542 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7b969ecb-2d6f-4647-9aa6-aa3a91142f71 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:40.184506 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7b969ecb-2d6f-4647-9aa6-aa3a91142f71 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:40.185188 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7b969ecb-2d6f-4647-9aa6-aa3a91142f71 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:40.185834 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7b969ecb-2d6f-4647-9aa6-aa3a91142f71 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:40.253930 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-7b969ecb-2d6f-4647-9aa6-aa3a91142f71 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:40.263440 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-7b969ecb-2d6f-4647-9aa6-aa3a91142f71 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca" status: 200 len: 1302 microversion: 2.1 time: 0.093143 Oct 17 03:57:40.264700 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 304/605] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:40 2022] GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca => generated 1302 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:40.372173 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-938b8c90-0a93-4105-b23f-3858f72a1263 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:40.372848 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-938b8c90-0a93-4105-b23f-3858f72a1263 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] [instance: 52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:40.379783 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-938b8c90-0a93-4105-b23f-3858f72a1263 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:40.380352 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-938b8c90-0a93-4105-b23f-3858f72a1263 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:40.380863 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-938b8c90-0a93-4105-b23f-3858f72a1263 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:40.381676 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-938b8c90-0a93-4105-b23f-3858f72a1263 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:40.382205 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-938b8c90-0a93-4105-b23f-3858f72a1263 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:40.382706 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-938b8c90-0a93-4105-b23f-3858f72a1263 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:40.450118 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-938b8c90-0a93-4105-b23f-3858f72a1263 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ffc76632a456d9e833381783d4dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed59353a4741cbb901808f7d2210d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:40.455564 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-c55e214d-9ea8-4a4f-9794-8a2f768da83a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:40.456176 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-c55e214d-9ea8-4a4f-9794-8a2f768da83a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:40.469317 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c55e214d-9ea8-4a4f-9794-8a2f768da83a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:40.469317 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c55e214d-9ea8-4a4f-9794-8a2f768da83a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:40.469317 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c55e214d-9ea8-4a4f-9794-8a2f768da83a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:40.469317 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c55e214d-9ea8-4a4f-9794-8a2f768da83a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:40.469778 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c55e214d-9ea8-4a4f-9794-8a2f768da83a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:40.469778 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c55e214d-9ea8-4a4f-9794-8a2f768da83a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:40.471717 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-938b8c90-0a93-4105-b23f-3858f72a1263 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] 10.222.0.16 "GET /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0" status: 200 len: 1303 microversion: 2.1 time: 0.102526 Oct 17 03:57:40.479540 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 302/606] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:40 2022] GET /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0 => generated 1303 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:40.628666 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-c55e214d-9ea8-4a4f-9794-8a2f768da83a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:40.638853 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-c55e214d-9ea8-4a4f-9794-8a2f768da83a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:40.640320 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-c55e214d-9ea8-4a4f-9794-8a2f768da83a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:40.644223 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-c55e214d-9ea8-4a4f-9794-8a2f768da83a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1808 microversion: 2.20 time: 0.190289 Oct 17 03:57:40.644223 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 305/607] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:57:40 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1808 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:57:40.654068 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-8efb9912-af66-49bd-86ba-2394cc355cf7 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:40.654810 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-8efb9912-af66-49bd-86ba-2394cc355cf7 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 57546995-2ef9-4773-a47a-13cbd2a831a9] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:40.661629 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8efb9912-af66-49bd-86ba-2394cc355cf7 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:40.662117 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8efb9912-af66-49bd-86ba-2394cc355cf7 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:40.662554 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8efb9912-af66-49bd-86ba-2394cc355cf7 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:40.663321 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8efb9912-af66-49bd-86ba-2394cc355cf7 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:40.663782 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8efb9912-af66-49bd-86ba-2394cc355cf7 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:40.664209 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8efb9912-af66-49bd-86ba-2394cc355cf7 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:40.818855 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-8efb9912-af66-49bd-86ba-2394cc355cf7 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:40.833352 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-8efb9912-af66-49bd-86ba-2394cc355cf7 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9" status: 200 len: 1736 microversion: 2.1 time: 0.183346 Oct 17 03:57:40.834822 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 303/608] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:40 2022] GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9 => generated 1736 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:57:41.288296 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-01e9d2c4-07c0-4d8d-b02f-720191b94a4e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:41.288911 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-01e9d2c4-07c0-4d8d-b02f-720191b94a4e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 6dabcc62-4829-4f97-830f-e82af447faca] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:41.295482 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-01e9d2c4-07c0-4d8d-b02f-720191b94a4e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:41.295971 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-01e9d2c4-07c0-4d8d-b02f-720191b94a4e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:41.296411 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-01e9d2c4-07c0-4d8d-b02f-720191b94a4e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:41.297107 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-01e9d2c4-07c0-4d8d-b02f-720191b94a4e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:41.297562 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-01e9d2c4-07c0-4d8d-b02f-720191b94a4e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:41.297988 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-01e9d2c4-07c0-4d8d-b02f-720191b94a4e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:41.362012 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-01e9d2c4-07c0-4d8d-b02f-720191b94a4e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:41.370094 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-01e9d2c4-07c0-4d8d-b02f-720191b94a4e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca" status: 200 len: 1302 microversion: 2.1 time: 0.085907 Oct 17 03:57:41.370660 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 306/609] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:41 2022] GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca => generated 1302 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:41.497162 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-34697506-ace1-4b4c-841f-17f3ee8351b8 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:41.497781 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-34697506-ace1-4b4c-841f-17f3ee8351b8 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] [instance: 52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:41.504347 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-34697506-ace1-4b4c-841f-17f3ee8351b8 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:41.504768 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-34697506-ace1-4b4c-841f-17f3ee8351b8 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:41.505205 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-34697506-ace1-4b4c-841f-17f3ee8351b8 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:41.505893 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-34697506-ace1-4b4c-841f-17f3ee8351b8 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:41.506350 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-34697506-ace1-4b4c-841f-17f3ee8351b8 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:41.506776 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-34697506-ace1-4b4c-841f-17f3ee8351b8 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:41.568923 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-34697506-ace1-4b4c-841f-17f3ee8351b8 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ffc76632a456d9e833381783d4dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed59353a4741cbb901808f7d2210d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:41.576669 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-34697506-ace1-4b4c-841f-17f3ee8351b8 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] 10.222.0.16 "GET /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0" status: 200 len: 1303 microversion: 2.1 time: 0.083537 Oct 17 03:57:41.577265 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 304/610] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:41 2022] GET /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0 => generated 1303 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:41.667133 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-5c381419-65b9-4765-af61-17ec8c4cff45 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:41.667782 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-5c381419-65b9-4765-af61-17ec8c4cff45 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:41.674102 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5c381419-65b9-4765-af61-17ec8c4cff45 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:41.674578 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5c381419-65b9-4765-af61-17ec8c4cff45 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:41.675013 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5c381419-65b9-4765-af61-17ec8c4cff45 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:41.675721 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5c381419-65b9-4765-af61-17ec8c4cff45 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:41.676169 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5c381419-65b9-4765-af61-17ec8c4cff45 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:41.676588 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5c381419-65b9-4765-af61-17ec8c4cff45 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:41.806228 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-5c381419-65b9-4765-af61-17ec8c4cff45 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:41.815496 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-5c381419-65b9-4765-af61-17ec8c4cff45 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:41.816954 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-5c381419-65b9-4765-af61-17ec8c4cff45 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:41.818104 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-5c381419-65b9-4765-af61-17ec8c4cff45 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1808 microversion: 2.20 time: 0.155503 Oct 17 03:57:41.818658 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 307/611] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:57:41 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:57:41.858422 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-97b0ad11-42f8-4453-ae43-f66c93136741 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:41.859032 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-97b0ad11-42f8-4453-ae43-f66c93136741 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 57546995-2ef9-4773-a47a-13cbd2a831a9] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:41.864969 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-97b0ad11-42f8-4453-ae43-f66c93136741 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:41.865451 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-97b0ad11-42f8-4453-ae43-f66c93136741 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:41.865887 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-97b0ad11-42f8-4453-ae43-f66c93136741 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:41.866577 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-97b0ad11-42f8-4453-ae43-f66c93136741 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:41.867031 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-97b0ad11-42f8-4453-ae43-f66c93136741 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:41.867476 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-97b0ad11-42f8-4453-ae43-f66c93136741 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:42.006219 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-97b0ad11-42f8-4453-ae43-f66c93136741 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:42.015035 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-97b0ad11-42f8-4453-ae43-f66c93136741 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9" status: 200 len: 1736 microversion: 2.1 time: 0.160385 Oct 17 03:57:42.015687 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 305/612] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:41 2022] GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:42.392875 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-fa96b611-2493-4b11-9214-c4d3bef94f83 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:42.393479 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-fa96b611-2493-4b11-9214-c4d3bef94f83 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 6dabcc62-4829-4f97-830f-e82af447faca] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:42.399431 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-fa96b611-2493-4b11-9214-c4d3bef94f83 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:42.400445 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-fa96b611-2493-4b11-9214-c4d3bef94f83 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:42.400876 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-fa96b611-2493-4b11-9214-c4d3bef94f83 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:42.401555 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-fa96b611-2493-4b11-9214-c4d3bef94f83 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:42.402005 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-fa96b611-2493-4b11-9214-c4d3bef94f83 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:42.402425 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-fa96b611-2493-4b11-9214-c4d3bef94f83 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:42.466748 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-fa96b611-2493-4b11-9214-c4d3bef94f83 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:42.474253 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-fa96b611-2493-4b11-9214-c4d3bef94f83 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca" status: 200 len: 1302 microversion: 2.1 time: 0.085235 Oct 17 03:57:42.474813 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 308/613] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:42 2022] GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca => generated 1302 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:42.599849 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-b166e35d-0522-4be9-a0db-d3d979e29652 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:42.600401 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-b166e35d-0522-4be9-a0db-d3d979e29652 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] [instance: 52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:42.606884 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b166e35d-0522-4be9-a0db-d3d979e29652 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:42.607391 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b166e35d-0522-4be9-a0db-d3d979e29652 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:42.607821 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b166e35d-0522-4be9-a0db-d3d979e29652 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:42.608504 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b166e35d-0522-4be9-a0db-d3d979e29652 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:42.609041 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b166e35d-0522-4be9-a0db-d3d979e29652 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:42.609461 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b166e35d-0522-4be9-a0db-d3d979e29652 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:42.669590 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-b166e35d-0522-4be9-a0db-d3d979e29652 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ffc76632a456d9e833381783d4dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed59353a4741cbb901808f7d2210d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:42.677244 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-b166e35d-0522-4be9-a0db-d3d979e29652 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] 10.222.0.16 "GET /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0" status: 200 len: 1303 microversion: 2.1 time: 0.081239 Oct 17 03:57:42.677912 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 306/614] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:42 2022] GET /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0 => generated 1303 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:42.843448 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-d142a9b8-c659-4ec2-b0b2-2f330046e7c8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:42.844061 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-d142a9b8-c659-4ec2-b0b2-2f330046e7c8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:42.850570 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d142a9b8-c659-4ec2-b0b2-2f330046e7c8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:42.851009 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d142a9b8-c659-4ec2-b0b2-2f330046e7c8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:42.851481 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d142a9b8-c659-4ec2-b0b2-2f330046e7c8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:42.852168 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d142a9b8-c659-4ec2-b0b2-2f330046e7c8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:42.852620 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d142a9b8-c659-4ec2-b0b2-2f330046e7c8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:42.853696 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d142a9b8-c659-4ec2-b0b2-2f330046e7c8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:42.979434 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-d142a9b8-c659-4ec2-b0b2-2f330046e7c8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:42.988038 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-d142a9b8-c659-4ec2-b0b2-2f330046e7c8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:42.992249 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-d142a9b8-c659-4ec2-b0b2-2f330046e7c8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:42.992249 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-d142a9b8-c659-4ec2-b0b2-2f330046e7c8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1808 microversion: 2.20 time: 0.151133 Oct 17 03:57:42.992249 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 309/615] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:57:42 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:57:43.038737 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-ce272ef2-8354-4164-b5ec-df28ae13e986 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:43.039394 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-ce272ef2-8354-4164-b5ec-df28ae13e986 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 57546995-2ef9-4773-a47a-13cbd2a831a9] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:43.045999 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ce272ef2-8354-4164-b5ec-df28ae13e986 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:43.047318 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ce272ef2-8354-4164-b5ec-df28ae13e986 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:43.047318 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ce272ef2-8354-4164-b5ec-df28ae13e986 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:43.047602 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ce272ef2-8354-4164-b5ec-df28ae13e986 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:43.048053 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ce272ef2-8354-4164-b5ec-df28ae13e986 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:43.048531 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ce272ef2-8354-4164-b5ec-df28ae13e986 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:43.180810 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-ce272ef2-8354-4164-b5ec-df28ae13e986 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:43.189059 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-ce272ef2-8354-4164-b5ec-df28ae13e986 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9" status: 200 len: 1736 microversion: 2.1 time: 0.154363 Oct 17 03:57:43.189636 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 307/616] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:43 2022] GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:43.496859 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-09c6fb2a-83a8-49a7-9481-020800538de9 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:43.497510 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-09c6fb2a-83a8-49a7-9481-020800538de9 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 6dabcc62-4829-4f97-830f-e82af447faca] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:43.504050 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-09c6fb2a-83a8-49a7-9481-020800538de9 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:43.506203 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-09c6fb2a-83a8-49a7-9481-020800538de9 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:43.506203 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-09c6fb2a-83a8-49a7-9481-020800538de9 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:43.506203 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-09c6fb2a-83a8-49a7-9481-020800538de9 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:43.506662 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-09c6fb2a-83a8-49a7-9481-020800538de9 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:43.506741 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-09c6fb2a-83a8-49a7-9481-020800538de9 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:43.578425 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-09c6fb2a-83a8-49a7-9481-020800538de9 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:43.586282 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-09c6fb2a-83a8-49a7-9481-020800538de9 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca" status: 200 len: 1312 microversion: 2.1 time: 0.093335 Oct 17 03:57:43.586860 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 310/617] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:43 2022] GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca => generated 1312 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:43.700761 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-49711664-ce41-4052-a42d-c3feb8e103aa tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:43.701441 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-49711664-ce41-4052-a42d-c3feb8e103aa tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] [instance: 52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:43.708029 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-49711664-ce41-4052-a42d-c3feb8e103aa tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:43.708511 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-49711664-ce41-4052-a42d-c3feb8e103aa tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:43.708950 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-49711664-ce41-4052-a42d-c3feb8e103aa tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:43.709639 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-49711664-ce41-4052-a42d-c3feb8e103aa tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:43.710091 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-49711664-ce41-4052-a42d-c3feb8e103aa tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:43.710527 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-49711664-ce41-4052-a42d-c3feb8e103aa tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:43.740978 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-49711664-ce41-4052-a42d-c3feb8e103aa tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:43.741357 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-49711664-ce41-4052-a42d-c3feb8e103aa tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:43.741798 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-49711664-ce41-4052-a42d-c3feb8e103aa tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:43.742249 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.objects.instance [None req-49711664-ce41-4052-a42d-c3feb8e103aa tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lazy-loading 'fault' on Instance uuid 52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0 {{(pid=125872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:57:43.783552 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-49711664-ce41-4052-a42d-c3feb8e103aa tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ffc76632a456d9e833381783d4dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed59353a4741cbb901808f7d2210d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:43.791106 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-49711664-ce41-4052-a42d-c3feb8e103aa tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] 10.222.0.16 "GET /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0" status: 200 len: 1308 microversion: 2.1 time: 0.094796 Oct 17 03:57:43.791868 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 308/618] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:43 2022] GET /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0 => generated 1308 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:44.022195 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-57719df6-cb19-4118-bdfa-f074a2846c73 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:44.023208 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-57719df6-cb19-4118-bdfa-f074a2846c73 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:44.030010 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-57719df6-cb19-4118-bdfa-f074a2846c73 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:44.030501 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-57719df6-cb19-4118-bdfa-f074a2846c73 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:44.030976 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-57719df6-cb19-4118-bdfa-f074a2846c73 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:44.031718 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-57719df6-cb19-4118-bdfa-f074a2846c73 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:44.032183 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-57719df6-cb19-4118-bdfa-f074a2846c73 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:44.036870 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-57719df6-cb19-4118-bdfa-f074a2846c73 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:44.164445 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-57719df6-cb19-4118-bdfa-f074a2846c73 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:44.174636 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-57719df6-cb19-4118-bdfa-f074a2846c73 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:44.176106 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-57719df6-cb19-4118-bdfa-f074a2846c73 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:44.178301 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-57719df6-cb19-4118-bdfa-f074a2846c73 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1808 microversion: 2.20 time: 0.159266 Oct 17 03:57:44.178301 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 311/619] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:57:44 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:57:44.213036 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-6aad0128-f538-486e-bc8c-a1d70ad8fe84 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:44.213784 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-6aad0128-f538-486e-bc8c-a1d70ad8fe84 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 57546995-2ef9-4773-a47a-13cbd2a831a9] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:44.220174 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6aad0128-f538-486e-bc8c-a1d70ad8fe84 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:44.220750 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6aad0128-f538-486e-bc8c-a1d70ad8fe84 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:44.221251 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6aad0128-f538-486e-bc8c-a1d70ad8fe84 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:44.222025 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6aad0128-f538-486e-bc8c-a1d70ad8fe84 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:44.222555 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6aad0128-f538-486e-bc8c-a1d70ad8fe84 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:44.223087 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6aad0128-f538-486e-bc8c-a1d70ad8fe84 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:44.358477 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-6aad0128-f538-486e-bc8c-a1d70ad8fe84 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:44.368059 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-6aad0128-f538-486e-bc8c-a1d70ad8fe84 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9" status: 200 len: 1736 microversion: 2.1 time: 0.158996 Oct 17 03:57:44.374990 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 309/620] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:44 2022] GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:44.610179 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-221b45ac-fb06-4452-97ea-fc511967eb86 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:44.610790 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-221b45ac-fb06-4452-97ea-fc511967eb86 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 6dabcc62-4829-4f97-830f-e82af447faca] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:44.616799 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-221b45ac-fb06-4452-97ea-fc511967eb86 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:44.622765 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-221b45ac-fb06-4452-97ea-fc511967eb86 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:44.622765 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-221b45ac-fb06-4452-97ea-fc511967eb86 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:44.622765 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-221b45ac-fb06-4452-97ea-fc511967eb86 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:44.622765 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-221b45ac-fb06-4452-97ea-fc511967eb86 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:44.623079 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-221b45ac-fb06-4452-97ea-fc511967eb86 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:44.813947 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-b71d82d8-0fc3-4924-bbee-ecf19925f3eb tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:44.815116 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-b71d82d8-0fc3-4924-bbee-ecf19925f3eb tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] [instance: 52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:44.821480 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b71d82d8-0fc3-4924-bbee-ecf19925f3eb tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:44.822477 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b71d82d8-0fc3-4924-bbee-ecf19925f3eb tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:44.822910 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b71d82d8-0fc3-4924-bbee-ecf19925f3eb tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:44.823629 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b71d82d8-0fc3-4924-bbee-ecf19925f3eb tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:44.824085 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b71d82d8-0fc3-4924-bbee-ecf19925f3eb tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:44.824503 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b71d82d8-0fc3-4924-bbee-ecf19925f3eb tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:44.851102 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-221b45ac-fb06-4452-97ea-fc511967eb86 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:44.856673 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b71d82d8-0fc3-4924-bbee-ecf19925f3eb tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:44.857212 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b71d82d8-0fc3-4924-bbee-ecf19925f3eb tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:44.857645 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b71d82d8-0fc3-4924-bbee-ecf19925f3eb tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:44.858093 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.objects.instance [None req-b71d82d8-0fc3-4924-bbee-ecf19925f3eb tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lazy-loading 'fault' on Instance uuid 52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0 {{(pid=125872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:57:44.858832 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-221b45ac-fb06-4452-97ea-fc511967eb86 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca" status: 200 len: 1367 microversion: 2.1 time: 0.252555 Oct 17 03:57:44.859415 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 312/621] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:44 2022] GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca => generated 1367 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:44.901534 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-b71d82d8-0fc3-4924-bbee-ecf19925f3eb tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ffc76632a456d9e833381783d4dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed59353a4741cbb901808f7d2210d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:44.909569 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-b71d82d8-0fc3-4924-bbee-ecf19925f3eb tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] 10.222.0.16 "GET /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0" status: 200 len: 1308 microversion: 2.1 time: 0.099535 Oct 17 03:57:44.912702 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 310/622] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:44 2022] GET /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0 => generated 1308 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:57:45.204017 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-b53e3182-639e-472f-8e55-07ca6e335d8f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:45.205082 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-b53e3182-639e-472f-8e55-07ca6e335d8f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:45.211106 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b53e3182-639e-472f-8e55-07ca6e335d8f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:45.211610 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b53e3182-639e-472f-8e55-07ca6e335d8f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:45.212050 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b53e3182-639e-472f-8e55-07ca6e335d8f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:45.212749 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b53e3182-639e-472f-8e55-07ca6e335d8f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:45.213204 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b53e3182-639e-472f-8e55-07ca6e335d8f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:45.213631 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b53e3182-639e-472f-8e55-07ca6e335d8f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:45.339010 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [req-8e804a84-a930-4a85-9f40-f49ba476c2c6 req-020f7ea7-b709-4b73-8f63-a70c795a5bf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dabcc62-4829-4f97-830f-e82af447faca", "tag": "75567cd8-4940-4ce0-8d82-997c7cc06bc0"}]} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:57:45.348540 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-8e804a84-a930-4a85-9f40-f49ba476c2c6 req-020f7ea7-b709-4b73-8f63-a70c795a5bf8 service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:45.349008 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-8e804a84-a930-4a85-9f40-f49ba476c2c6 req-020f7ea7-b709-4b73-8f63-a70c795a5bf8 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:45.349432 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-8e804a84-a930-4a85-9f40-f49ba476c2c6 req-020f7ea7-b709-4b73-8f63-a70c795a5bf8 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:45.360085 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.compute.server_external_events [req-8e804a84-a930-4a85-9f40-f49ba476c2c6 req-020f7ea7-b709-4b73-8f63-a70c795a5bf8 service nova] Creating event network-changed:75567cd8-4940-4ce0-8d82-997c7cc06bc0 for instance 6dabcc62-4829-4f97-830f-e82af447faca on hv-cinder-81558 Oct 17 03:57:45.365035 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [req-8e804a84-a930-4a85-9f40-f49ba476c2c6 req-020f7ea7-b709-4b73-8f63-a70c795a5bf8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029681 Oct 17 03:57:45.369239 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 311/623] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 03:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 03:57:45.403677 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-05eae468-cf58-4c7c-b4b3-b3216ed6e31c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:45.403677 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-05eae468-cf58-4c7c-b4b3-b3216ed6e31c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 57546995-2ef9-4773-a47a-13cbd2a831a9] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:45.403951 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-b53e3182-639e-472f-8e55-07ca6e335d8f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:45.405977 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-05eae468-cf58-4c7c-b4b3-b3216ed6e31c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:45.413028 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-05eae468-cf58-4c7c-b4b3-b3216ed6e31c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:45.413684 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-05eae468-cf58-4c7c-b4b3-b3216ed6e31c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:45.414124 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-b53e3182-639e-472f-8e55-07ca6e335d8f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:45.414579 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-05eae468-cf58-4c7c-b4b3-b3216ed6e31c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:45.415824 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-05eae468-cf58-4c7c-b4b3-b3216ed6e31c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:45.416466 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-05eae468-cf58-4c7c-b4b3-b3216ed6e31c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:45.416751 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-b53e3182-639e-472f-8e55-07ca6e335d8f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:45.418001 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-b53e3182-639e-472f-8e55-07ca6e335d8f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1808 microversion: 2.20 time: 0.217882 Oct 17 03:57:45.419189 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 313/624] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:57:45 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1808 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:57:45.546212 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-05eae468-cf58-4c7c-b4b3-b3216ed6e31c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:45.554369 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-05eae468-cf58-4c7c-b4b3-b3216ed6e31c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9" status: 200 len: 1736 microversion: 2.1 time: 0.160188 Oct 17 03:57:45.554966 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 312/625] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:45 2022] GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:57:45.886191 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-b13ac7e1-6a19-4920-a8ea-6eb5fce29f87 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:45.886819 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-b13ac7e1-6a19-4920-a8ea-6eb5fce29f87 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 6dabcc62-4829-4f97-830f-e82af447faca] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:45.892729 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b13ac7e1-6a19-4920-a8ea-6eb5fce29f87 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:45.893219 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b13ac7e1-6a19-4920-a8ea-6eb5fce29f87 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:45.893658 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b13ac7e1-6a19-4920-a8ea-6eb5fce29f87 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:45.894362 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b13ac7e1-6a19-4920-a8ea-6eb5fce29f87 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:45.894872 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b13ac7e1-6a19-4920-a8ea-6eb5fce29f87 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:45.895336 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b13ac7e1-6a19-4920-a8ea-6eb5fce29f87 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:45.914929 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_cell1:SELECT=100 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:57:45.934233 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-a784ce1a-3cbc-40cd-a883-ff3bac15e175 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:45.934932 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-a784ce1a-3cbc-40cd-a883-ff3bac15e175 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] [instance: 52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:45.941693 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a784ce1a-3cbc-40cd-a883-ff3bac15e175 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:45.942253 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a784ce1a-3cbc-40cd-a883-ff3bac15e175 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:45.942823 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a784ce1a-3cbc-40cd-a883-ff3bac15e175 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:45.943628 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a784ce1a-3cbc-40cd-a883-ff3bac15e175 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:45.944168 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a784ce1a-3cbc-40cd-a883-ff3bac15e175 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:45.944653 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a784ce1a-3cbc-40cd-a883-ff3bac15e175 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:45.959375 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.wsgi [None req-a784ce1a-3cbc-40cd-a883-ff3bac15e175 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] HTTP exception thrown: Instance 52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0 could not be found. Oct 17 03:57:45.961018 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-a784ce1a-3cbc-40cd-a883-ff3bac15e175 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Request method failure captured: Oct 17 03:57:45.961018 dv-cinder-815582-16-smb devstack@n-api.service[125872]: request: GET /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0 HTTP/1.1 Oct 17 03:57:45.961018 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Accept: application/json Oct 17 03:57:45.961018 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Accept-Encoding: identity Oct 17 03:57:45.961018 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Connection: close Oct 17 03:57:45.961018 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Content-Length: 0 Oct 17 03:57:45.961018 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Content-Type: application/json Oct 17 03:57:45.961018 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Host: 10.222.0.16 Oct 17 03:57:45.961018 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Openstack-System-Scope: None Oct 17 03:57:45.961018 dv-cinder-815582-16-smb devstack@n-api.service[125872]: User-Agent: python-urllib3/1.26.12 Oct 17 03:57:45.961018 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Auth-Token: gAAAAABjTNJXx73OaFsOkts5_8d4OIVOo-yMRjx5qSMqgK45YFQ83ehknY221EKopQZVDKZ0Cqrr0Vf8pXswQpZdWU2j7XxL1BUpjJZrFO8SjR0kMkZLbPIx5moZwQ6cdCxOcUxXKn7p3YbzcTIyqrxtC0fL-uiHWOMXnxejxYPoU0BxWDjBhZM Oct 17 03:57:45.961018 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Domain-Id: None Oct 17 03:57:45.961018 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Domain-Name: None Oct 17 03:57:45.961018 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Identity-Status: Confirmed Oct 17 03:57:45.961018 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Is-Admin-Project: True Oct 17 03:57:45.961018 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Domain-Id: default Oct 17 03:57:45.961018 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Domain-Name: Default Oct 17 03:57:45.961018 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Id: f9ed59353a4741cbb901808f7d2210d0 Oct 17 03:57:45.961018 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2080633967 Oct 17 03:57:45.961018 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Role: reader,member Oct 17 03:57:45.961018 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Roles: reader,member Oct 17 03:57:45.963060 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f9ed59353a4741cbb901808f7d2210d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f9ed59353a4741cbb901808f7d2210d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f9ed59353a4741cbb901808f7d2210d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f9ed59353a4741cbb901808f7d2210d0", "adminURL": "http://10.222.0.16:8080"}]}] Oct 17 03:57:45.963060 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant: tempest-VolumesSnapshotTestJSON-2080633967 Oct 17 03:57:45.963060 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant-Id: f9ed59353a4741cbb901808f7d2210d0 Oct 17 03:57:45.963060 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2080633967 Oct 17 03:57:45.963060 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User: tempest-VolumesSnapshotTestJSON-2080633967-project Oct 17 03:57:45.963060 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Domain-Id: default Oct 17 03:57:45.963060 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Domain-Name: Default Oct 17 03:57:45.963060 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Id: c53ffc76632a456d9e833381783d4dd8 Oct 17 03:57:45.963060 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Name: tempest-VolumesSnapshotTestJSON-2080633967-project Oct 17 03:57:45.963060 dv-cinder-815582-16-smb devstack@n-api.service[125872]: method: > Oct 17 03:57:45.963060 dv-cinder-815582-16-smb devstack@n-api.service[125872]: exception: Instance 52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0 could not be found. Oct 17 03:57:45.963060 dv-cinder-815582-16-smb devstack@n-api.service[125872]: action_args: {'id': '52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0'} Oct 17 03:57:45.963996 dv-cinder-815582-16-smb devstack@n-api.service[125872]: {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:57:45.963996 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:57:45.963996 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 03:57:45.963996 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 03:57:45.963996 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 03:57:45.963996 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 03:57:45.963996 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 03:57:45.963996 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 03:57:45.963996 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 03:57:45.963996 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 03:57:45.963996 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0 could not be found. Oct 17 03:57:45.963996 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:57:45.963996 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:57:45.963996 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:57:45.963996 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:57:45.963996 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:57:45.963996 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:57:45.963996 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:57:45.963996 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:57:45.963996 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:57:45.965266 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:57:45.965266 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 03:57:45.965266 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 03:57:45.965266 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 03:57:45.965266 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 03:57:45.965266 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 03:57:45.965266 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:57:45.965266 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0 could not be found. Oct 17 03:57:45.965266 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:57:45.965266 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:57:45.965266 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:57:45.965266 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:57:45.965266 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:57:45.965266 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:57:45.965266 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:57:45.965266 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:57:45.965266 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0 could not be found. Oct 17 03:57:45.965266 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:57:45.966409 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-a784ce1a-3cbc-40cd-a883-ff3bac15e175 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Returning 404 to user: Instance 52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0 could not be found. {{(pid=125872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:57:45.966409 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-a784ce1a-3cbc-40cd-a883-ff3bac15e175 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] 10.222.0.16 "GET /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0" status: 404 len: 111 microversion: 2.1 time: 0.032456 Oct 17 03:57:45.966409 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 313/626] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:45 2022] GET /compute/v2.1/servers/52ca6c1a-6d18-4b3f-9dea-20ffb8bfb0a0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 03:57:46.031725 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-b13ac7e1-6a19-4920-a8ea-6eb5fce29f87 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:46.039154 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-b13ac7e1-6a19-4920-a8ea-6eb5fce29f87 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca" status: 200 len: 1367 microversion: 2.1 time: 0.157179 Oct 17 03:57:46.039762 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 314/627] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:45 2022] GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:46.444156 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-000313e9-b705-406e-bafe-1e45a0cf94ed tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:46.444758 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-000313e9-b705-406e-bafe-1e45a0cf94ed tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:46.450580 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-000313e9-b705-406e-bafe-1e45a0cf94ed tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:46.451057 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-000313e9-b705-406e-bafe-1e45a0cf94ed tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:46.451516 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-000313e9-b705-406e-bafe-1e45a0cf94ed tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:46.452193 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-000313e9-b705-406e-bafe-1e45a0cf94ed tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:46.452643 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-000313e9-b705-406e-bafe-1e45a0cf94ed tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:46.453056 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-000313e9-b705-406e-bafe-1e45a0cf94ed tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:46.578234 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-52812dfb-fe68-4a94-9487-252cf833d98c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:46.578948 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-52812dfb-fe68-4a94-9487-252cf833d98c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 57546995-2ef9-4773-a47a-13cbd2a831a9] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:46.585729 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-52812dfb-fe68-4a94-9487-252cf833d98c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:46.586456 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-52812dfb-fe68-4a94-9487-252cf833d98c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:46.586904 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-52812dfb-fe68-4a94-9487-252cf833d98c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:46.588557 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-52812dfb-fe68-4a94-9487-252cf833d98c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:46.589026 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-52812dfb-fe68-4a94-9487-252cf833d98c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:46.589455 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-52812dfb-fe68-4a94-9487-252cf833d98c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:46.592781 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-000313e9-b705-406e-bafe-1e45a0cf94ed tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:46.601856 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-000313e9-b705-406e-bafe-1e45a0cf94ed tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:46.615555 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-000313e9-b705-406e-bafe-1e45a0cf94ed tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:46.615555 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-000313e9-b705-406e-bafe-1e45a0cf94ed tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1808 microversion: 2.20 time: 0.165168 Oct 17 03:57:46.615555 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 314/628] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:57:46 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:57:46.813610 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-52812dfb-fe68-4a94-9487-252cf833d98c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:46.826166 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-52812dfb-fe68-4a94-9487-252cf833d98c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9" status: 200 len: 1736 microversion: 2.1 time: 0.248225 Oct 17 03:57:46.826166 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 315/629] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:46 2022] GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9 => generated 1736 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:57:47.061973 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-73e5325d-056c-4dff-ad71-5a19a95727a8 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:47.062638 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-73e5325d-056c-4dff-ad71-5a19a95727a8 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 6dabcc62-4829-4f97-830f-e82af447faca] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:47.069319 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-73e5325d-056c-4dff-ad71-5a19a95727a8 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:47.069831 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-73e5325d-056c-4dff-ad71-5a19a95727a8 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:47.070268 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-73e5325d-056c-4dff-ad71-5a19a95727a8 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:47.070964 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-73e5325d-056c-4dff-ad71-5a19a95727a8 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:47.071440 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-73e5325d-056c-4dff-ad71-5a19a95727a8 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:47.071893 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-73e5325d-056c-4dff-ad71-5a19a95727a8 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:47.200113 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-73e5325d-056c-4dff-ad71-5a19a95727a8 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:47.207769 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-73e5325d-056c-4dff-ad71-5a19a95727a8 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca" status: 200 len: 1367 microversion: 2.1 time: 0.149755 Oct 17 03:57:47.208335 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 315/630] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:47 2022] GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:57:47.298548 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [req-80821d0a-08da-4139-8646-0ef97d716b14 req-eca4601c-fdbe-44b4-82c9-5deaac1a79a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0982f171-946d-4314-89f2-c139e6bf9adf", "name": "network-vif-plugged", "status": "completed", "tag": "8d6b4ea5-ab61-4510-be24-bef55f15afa4"}]} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:57:47.308488 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-80821d0a-08da-4139-8646-0ef97d716b14 req-eca4601c-fdbe-44b4-82c9-5deaac1a79a7 service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:47.308959 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-80821d0a-08da-4139-8646-0ef97d716b14 req-eca4601c-fdbe-44b4-82c9-5deaac1a79a7 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:47.309384 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-80821d0a-08da-4139-8646-0ef97d716b14 req-eca4601c-fdbe-44b4-82c9-5deaac1a79a7 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:47.319969 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.compute.server_external_events [req-80821d0a-08da-4139-8646-0ef97d716b14 req-eca4601c-fdbe-44b4-82c9-5deaac1a79a7 service nova] Creating event network-vif-plugged:8d6b4ea5-ab61-4510-be24-bef55f15afa4 for instance 0982f171-946d-4314-89f2-c139e6bf9adf on hv-cinder-81558 Oct 17 03:57:47.325479 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [req-80821d0a-08da-4139-8646-0ef97d716b14 req-eca4601c-fdbe-44b4-82c9-5deaac1a79a7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030555 Oct 17 03:57:47.326054 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 316/631] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 03:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:57:47.633047 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-2ce3eb26-11e5-46a3-9a73-0173fa0601e2 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:47.633656 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-2ce3eb26-11e5-46a3-9a73-0173fa0601e2 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:47.640471 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2ce3eb26-11e5-46a3-9a73-0173fa0601e2 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:47.640952 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2ce3eb26-11e5-46a3-9a73-0173fa0601e2 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:47.641450 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2ce3eb26-11e5-46a3-9a73-0173fa0601e2 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:47.642142 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2ce3eb26-11e5-46a3-9a73-0173fa0601e2 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:47.642598 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2ce3eb26-11e5-46a3-9a73-0173fa0601e2 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:47.643019 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2ce3eb26-11e5-46a3-9a73-0173fa0601e2 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:47.770500 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-2ce3eb26-11e5-46a3-9a73-0173fa0601e2 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:47.779024 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-2ce3eb26-11e5-46a3-9a73-0173fa0601e2 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:47.780484 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-2ce3eb26-11e5-46a3-9a73-0173fa0601e2 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:47.781623 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-2ce3eb26-11e5-46a3-9a73-0173fa0601e2 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1808 microversion: 2.20 time: 0.152561 Oct 17 03:57:47.782187 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 316/632] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:57:47 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:57:47.847543 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-490193fe-c6c6-41ad-8fd6-f45505ffb623 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:47.848253 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-490193fe-c6c6-41ad-8fd6-f45505ffb623 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 57546995-2ef9-4773-a47a-13cbd2a831a9] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:47.854847 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-490193fe-c6c6-41ad-8fd6-f45505ffb623 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:47.855361 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-490193fe-c6c6-41ad-8fd6-f45505ffb623 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:47.855798 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-490193fe-c6c6-41ad-8fd6-f45505ffb623 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:47.856488 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-490193fe-c6c6-41ad-8fd6-f45505ffb623 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:47.856945 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-490193fe-c6c6-41ad-8fd6-f45505ffb623 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:47.860204 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-490193fe-c6c6-41ad-8fd6-f45505ffb623 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:47.985707 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-490193fe-c6c6-41ad-8fd6-f45505ffb623 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:47.993925 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-490193fe-c6c6-41ad-8fd6-f45505ffb623 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9" status: 200 len: 1716 microversion: 2.1 time: 0.151085 Oct 17 03:57:47.995137 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 317/633] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:47 2022] GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9 => generated 1716 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:48.110251 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-c30452f6-75fa-40ec-ad0d-304ed1468c6c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:48.110771 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-c30452f6-75fa-40ec-ad0d-304ed1468c6c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 57546995-2ef9-4773-a47a-13cbd2a831a9] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:48.117101 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c30452f6-75fa-40ec-ad0d-304ed1468c6c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:48.117585 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c30452f6-75fa-40ec-ad0d-304ed1468c6c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:48.118004 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c30452f6-75fa-40ec-ad0d-304ed1468c6c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:48.118684 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c30452f6-75fa-40ec-ad0d-304ed1468c6c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:48.119131 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c30452f6-75fa-40ec-ad0d-304ed1468c6c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:48.119572 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c30452f6-75fa-40ec-ad0d-304ed1468c6c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:48.137170 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_cell1:SELECT=100 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:57:48.199809 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.wsgi [None req-c30452f6-75fa-40ec-ad0d-304ed1468c6c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] HTTP exception thrown: Cannot 'detach_volume' instance 57546995-2ef9-4773-a47a-13cbd2a831a9 while it is in vm_state rescued Oct 17 03:57:48.201296 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-c30452f6-75fa-40ec-ad0d-304ed1468c6c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Request method failure captured: Oct 17 03:57:48.201296 dv-cinder-815582-16-smb devstack@n-api.service[125872]: request: DELETE /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9/os-volume_attachments/b92cd2b1-85e3-409b-bef1-1d2a0932c463 HTTP/1.1 Oct 17 03:57:48.201296 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Accept: application/json Oct 17 03:57:48.201296 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Accept-Encoding: identity Oct 17 03:57:48.201296 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Connection: close Oct 17 03:57:48.201296 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Content-Length: 0 Oct 17 03:57:48.201296 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Content-Type: application/json Oct 17 03:57:48.201296 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Host: 10.222.0.16 Oct 17 03:57:48.201296 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Openstack-System-Scope: None Oct 17 03:57:48.201296 dv-cinder-815582-16-smb devstack@n-api.service[125872]: User-Agent: python-urllib3/1.26.12 Oct 17 03:57:48.201296 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Auth-Token: gAAAAABjTNHYLxUsgcq_ACPqiARQRHFZX3xLv8SayCvNAWGNHgFQpkcgEDanwG27BF2rHPhh0X13DIu7TiIER2OGNrGDta7scBiyr4QHstEFtiE-NGtlSlpYsVJP4E4zCTmikL_tTbEERMy_oJ_SGh8iD1-z3BXcak8DQ79G1K_sLtgABtxSp2A Oct 17 03:57:48.201296 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Domain-Id: None Oct 17 03:57:48.201296 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Domain-Name: None Oct 17 03:57:48.201296 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Identity-Status: Confirmed Oct 17 03:57:48.201296 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Is-Admin-Project: True Oct 17 03:57:48.201296 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Domain-Id: default Oct 17 03:57:48.201296 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Domain-Name: Default Oct 17 03:57:48.201296 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Id: b033d35610f34401a99b912f145eb317 Oct 17 03:57:48.201296 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-464495139 Oct 17 03:57:48.201296 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Role: reader,member Oct 17 03:57:48.201296 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Roles: reader,member Oct 17 03:57:48.202861 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b033d35610f34401a99b912f145eb317"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b033d35610f34401a99b912f145eb317"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b033d35610f34401a99b912f145eb317"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b033d35610f34401a99b912f145eb317", "adminURL": "http://10.222.0.16:8080"}]}] Oct 17 03:57:48.202861 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant: tempest-ServerRescueNegativeTestJSON-464495139 Oct 17 03:57:48.202861 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant-Id: b033d35610f34401a99b912f145eb317 Oct 17 03:57:48.202861 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-464495139 Oct 17 03:57:48.202861 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User: tempest-ServerRescueNegativeTestJSON-464495139-project Oct 17 03:57:48.202861 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Domain-Id: default Oct 17 03:57:48.202861 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Domain-Name: Default Oct 17 03:57:48.202861 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Id: fa0a6947667d48bfabf6aefad09c8325 Oct 17 03:57:48.202861 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Name: tempest-ServerRescueNegativeTestJSON-464495139-project Oct 17 03:57:48.202861 dv-cinder-815582-16-smb devstack@n-api.service[125872]: method: > Oct 17 03:57:48.202861 dv-cinder-815582-16-smb devstack@n-api.service[125872]: exception: Cannot 'detach_volume' instance 57546995-2ef9-4773-a47a-13cbd2a831a9 while it is in vm_state rescued Oct 17 03:57:48.203690 dv-cinder-815582-16-smb devstack@n-api.service[125872]: action_args: {'server_id': '57546995-2ef9-4773-a47a-13cbd2a831a9', 'id': 'b92cd2b1-85e3-409b-bef1-1d2a0932c463'} Oct 17 03:57:48.203690 dv-cinder-815582-16-smb devstack@n-api.service[125872]: {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:57:48.203690 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:57:48.203690 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 17 03:57:48.203690 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 17 03:57:48.203690 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 03:57:48.203690 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 03:57:48.203690 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 17 03:57:48.203690 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 03:57:48.203690 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 57546995-2ef9-4773-a47a-13cbd2a831a9 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 17 03:57:48.203690 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:57:48.203690 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:57:48.203690 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:57:48.203690 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:57:48.203690 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:57:48.203690 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:57:48.203690 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:57:48.203690 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:57:48.203690 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:57:48.203690 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:57:48.205061 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 17 03:57:48.205061 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 17 03:57:48.205061 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 03:57:48.205061 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 03:57:48.205061 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 57546995-2ef9-4773-a47a-13cbd2a831a9 while it is in vm_state rescued Oct 17 03:57:48.205061 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:57:48.205061 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:57:48.205061 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:57:48.205061 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:57:48.205061 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:57:48.205061 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:57:48.205061 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:57:48.205061 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:57:48.205061 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 57546995-2ef9-4773-a47a-13cbd2a831a9 while it is in vm_state rescued Oct 17 03:57:48.205061 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:57:48.205061 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-c30452f6-75fa-40ec-ad0d-304ed1468c6c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Returning 409 to user: Cannot 'detach_volume' instance 57546995-2ef9-4773-a47a-13cbd2a831a9 while it is in vm_state rescued {{(pid=125872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:57:48.206263 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-c30452f6-75fa-40ec-ad0d-304ed1468c6c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "DELETE /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9/os-volume_attachments/b92cd2b1-85e3-409b-bef1-1d2a0932c463" status: 409 len: 152 microversion: 2.1 time: 0.096460 Oct 17 03:57:48.206263 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 317/634] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Oct 17 03:57:48 2022] DELETE /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9/os-volume_attachments/b92cd2b1-85e3-409b-bef1-1d2a0932c463 => generated 152 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 03:57:48.211716 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-bfdfed71-b9a5-449d-8502-bd227620e7b9 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:57:48.212272 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-bfdfed71-b9a5-449d-8502-bd227620e7b9 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 57546995-2ef9-4773-a47a-13cbd2a831a9] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:48.218559 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-bfdfed71-b9a5-449d-8502-bd227620e7b9 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:48.219036 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-bfdfed71-b9a5-449d-8502-bd227620e7b9 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:48.219543 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-bfdfed71-b9a5-449d-8502-bd227620e7b9 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:48.220225 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-bfdfed71-b9a5-449d-8502-bd227620e7b9 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:48.220676 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-bfdfed71-b9a5-449d-8502-bd227620e7b9 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:48.221101 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-bfdfed71-b9a5-449d-8502-bd227620e7b9 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:48.231750 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-13500b2d-a98c-4fe0-9912-9418f34435fc tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:48.232388 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-13500b2d-a98c-4fe0-9912-9418f34435fc tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 6dabcc62-4829-4f97-830f-e82af447faca] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:48.238327 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-13500b2d-a98c-4fe0-9912-9418f34435fc tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:48.238810 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-13500b2d-a98c-4fe0-9912-9418f34435fc tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:48.239275 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-13500b2d-a98c-4fe0-9912-9418f34435fc tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:48.239971 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-13500b2d-a98c-4fe0-9912-9418f34435fc tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:48.240424 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-13500b2d-a98c-4fe0-9912-9418f34435fc tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:48.240849 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-13500b2d-a98c-4fe0-9912-9418f34435fc tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:48.370744 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-13500b2d-a98c-4fe0-9912-9418f34435fc tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:48.378507 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-13500b2d-a98c-4fe0-9912-9418f34435fc tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca" status: 200 len: 1367 microversion: 2.1 time: 0.151145 Oct 17 03:57:48.379068 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 318/635] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:48 2022] GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:57:48.418118 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-bfdfed71-b9a5-449d-8502-bd227620e7b9 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "POST /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9/action" status: 202 len: 0 microversion: 2.1 time: 0.210039 Oct 17 03:57:48.418752 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 318/636] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 17 03:57:48 2022] POST /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 03:57:48.427115 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-78f0e6e6-faba-48dd-b629-d5d075eb9eca tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:48.427775 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-78f0e6e6-faba-48dd-b629-d5d075eb9eca tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 57546995-2ef9-4773-a47a-13cbd2a831a9] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:48.433699 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-78f0e6e6-faba-48dd-b629-d5d075eb9eca tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:48.434189 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-78f0e6e6-faba-48dd-b629-d5d075eb9eca tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:48.434630 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-78f0e6e6-faba-48dd-b629-d5d075eb9eca tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:48.435362 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-78f0e6e6-faba-48dd-b629-d5d075eb9eca tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:48.435823 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-78f0e6e6-faba-48dd-b629-d5d075eb9eca tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:48.436261 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-78f0e6e6-faba-48dd-b629-d5d075eb9eca tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:48.568428 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-78f0e6e6-faba-48dd-b629-d5d075eb9eca tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:48.577700 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-78f0e6e6-faba-48dd-b629-d5d075eb9eca tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9" status: 200 len: 1724 microversion: 2.1 time: 0.154373 Oct 17 03:57:48.580070 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 319/637] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:48 2022] GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:48.808828 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-692a54f5-5481-4aad-b707-2a16bcf62c28 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:48.809438 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-692a54f5-5481-4aad-b707-2a16bcf62c28 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:48.815559 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-692a54f5-5481-4aad-b707-2a16bcf62c28 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:48.819417 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-692a54f5-5481-4aad-b707-2a16bcf62c28 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:48.819417 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-692a54f5-5481-4aad-b707-2a16bcf62c28 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:48.819417 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-692a54f5-5481-4aad-b707-2a16bcf62c28 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:48.819417 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-692a54f5-5481-4aad-b707-2a16bcf62c28 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:48.819774 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-692a54f5-5481-4aad-b707-2a16bcf62c28 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:48.949233 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-692a54f5-5481-4aad-b707-2a16bcf62c28 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:48.957875 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-692a54f5-5481-4aad-b707-2a16bcf62c28 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:48.959392 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-692a54f5-5481-4aad-b707-2a16bcf62c28 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:48.960565 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-692a54f5-5481-4aad-b707-2a16bcf62c28 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1808 microversion: 2.20 time: 0.156713 Oct 17 03:57:48.961128 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 319/638] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:57:48 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:57:49.401822 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-ea7e24d4-fa78-48f4-ad1f-5e9e7e223f4d tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:49.402452 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-ea7e24d4-fa78-48f4-ad1f-5e9e7e223f4d tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 6dabcc62-4829-4f97-830f-e82af447faca] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:49.409250 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ea7e24d4-fa78-48f4-ad1f-5e9e7e223f4d tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:49.409797 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ea7e24d4-fa78-48f4-ad1f-5e9e7e223f4d tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:49.413070 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ea7e24d4-fa78-48f4-ad1f-5e9e7e223f4d tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:49.413070 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ea7e24d4-fa78-48f4-ad1f-5e9e7e223f4d tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:49.413070 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ea7e24d4-fa78-48f4-ad1f-5e9e7e223f4d tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:49.413070 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ea7e24d4-fa78-48f4-ad1f-5e9e7e223f4d tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:49.546750 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-ea7e24d4-fa78-48f4-ad1f-5e9e7e223f4d tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:49.554551 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-ea7e24d4-fa78-48f4-ad1f-5e9e7e223f4d tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca" status: 200 len: 1367 microversion: 2.1 time: 0.157068 Oct 17 03:57:49.557474 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 320/639] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:49 2022] GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:49.604727 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-a93dd15d-930b-4611-ad98-714acea05675 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:49.605296 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-a93dd15d-930b-4611-ad98-714acea05675 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 57546995-2ef9-4773-a47a-13cbd2a831a9] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:49.611576 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a93dd15d-930b-4611-ad98-714acea05675 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:49.612097 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a93dd15d-930b-4611-ad98-714acea05675 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:49.612553 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a93dd15d-930b-4611-ad98-714acea05675 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:49.613252 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a93dd15d-930b-4611-ad98-714acea05675 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:49.613704 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a93dd15d-930b-4611-ad98-714acea05675 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:49.614124 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a93dd15d-930b-4611-ad98-714acea05675 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:49.763571 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-a93dd15d-930b-4611-ad98-714acea05675 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:49.771723 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-a93dd15d-930b-4611-ad98-714acea05675 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9" status: 200 len: 1724 microversion: 2.1 time: 0.171668 Oct 17 03:57:49.772922 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 320/640] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:49 2022] GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:49.985878 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-2a766203-98b7-43a4-bd2a-a9d17e674c00 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:49.986486 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-2a766203-98b7-43a4-bd2a-a9d17e674c00 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:49.992447 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2a766203-98b7-43a4-bd2a-a9d17e674c00 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:49.992926 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2a766203-98b7-43a4-bd2a-a9d17e674c00 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:49.993352 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2a766203-98b7-43a4-bd2a-a9d17e674c00 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:49.994030 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2a766203-98b7-43a4-bd2a-a9d17e674c00 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:49.995104 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2a766203-98b7-43a4-bd2a-a9d17e674c00 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:49.995549 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2a766203-98b7-43a4-bd2a-a9d17e674c00 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:50.131812 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-2a766203-98b7-43a4-bd2a-a9d17e674c00 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:50.141175 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-2a766203-98b7-43a4-bd2a-a9d17e674c00 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:50.142790 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-2a766203-98b7-43a4-bd2a-a9d17e674c00 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:50.143988 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-2a766203-98b7-43a4-bd2a-a9d17e674c00 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1808 microversion: 2.20 time: 0.161984 Oct 17 03:57:50.144543 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 321/641] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:57:49 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:57:50.221806 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-7525510a-0fad-4f68-bf32-89a546fce2b5 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1565403041", "imageRef": "add1979e-0a3b-4403-a8ae-8d9a7b045fc2", "flavorRef": "452", "networks": [{"uuid": "5315d0bd-538c-4a9e-975e-d56c527bda19"}]}} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:57:50.280173 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.network.neutron [None req-7525510a-0fad-4f68-bf32-89a546fce2b5 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] validate_networks() for [('5315d0bd-538c-4a9e-975e-d56c527bda19', None, None, None, None, None)] {{(pid=125871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 03:57:50.578006 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-d72318d3-54e8-4845-b7c1-7c53c6fa3a5c tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:50.578730 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-d72318d3-54e8-4845-b7c1-7c53c6fa3a5c tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 6dabcc62-4829-4f97-830f-e82af447faca] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:50.594169 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d72318d3-54e8-4845-b7c1-7c53c6fa3a5c tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:50.594943 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d72318d3-54e8-4845-b7c1-7c53c6fa3a5c tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:50.595582 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d72318d3-54e8-4845-b7c1-7c53c6fa3a5c tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:50.596466 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d72318d3-54e8-4845-b7c1-7c53c6fa3a5c tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:50.597215 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d72318d3-54e8-4845-b7c1-7c53c6fa3a5c tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:50.597813 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d72318d3-54e8-4845-b7c1-7c53c6fa3a5c tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:50.634028 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.virt.hardware [None req-7525510a-0fad-4f68-bf32-89a546fce2b5 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Flavor limits 0:0:0 {{(pid=125871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 03:57:50.634778 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.virt.hardware [None req-7525510a-0fad-4f68-bf32-89a546fce2b5 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Image limits 0:0:0 {{(pid=125871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 03:57:50.635204 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.virt.hardware [None req-7525510a-0fad-4f68-bf32-89a546fce2b5 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Flavor pref 0:0:0 {{(pid=125871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 03:57:50.636910 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.virt.hardware [None req-7525510a-0fad-4f68-bf32-89a546fce2b5 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Image pref 0:0:0 {{(pid=125871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 03:57:50.636910 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.virt.hardware [None req-7525510a-0fad-4f68-bf32-89a546fce2b5 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 03:57:50.645435 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7525510a-0fad-4f68-bf32-89a546fce2b5 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:50.646119 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7525510a-0fad-4f68-bf32-89a546fce2b5 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:50.646711 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7525510a-0fad-4f68-bf32-89a546fce2b5 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:50.647628 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7525510a-0fad-4f68-bf32-89a546fce2b5 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:50.648259 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7525510a-0fad-4f68-bf32-89a546fce2b5 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:50.648687 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7525510a-0fad-4f68-bf32-89a546fce2b5 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:50.666133 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.quota [None req-7525510a-0fad-4f68-bf32-89a546fce2b5 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Getting quotas for project f9ed59353a4741cbb901808f7d2210d0. Resources: {'cores', 'instances', 'ram'} {{(pid=125871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 03:57:50.670728 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.quota [None req-7525510a-0fad-4f68-bf32-89a546fce2b5 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Getting quotas for user c53ffc76632a456d9e833381783d4dd8 and project f9ed59353a4741cbb901808f7d2210d0. Resources: {'cores', 'instances', 'ram'} {{(pid=125871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 03:57:50.682045 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-7525510a-0fad-4f68-bf32-89a546fce2b5 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Going to run 1 instances... {{(pid=125871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 03:57:50.684411 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-7525510a-0fad-4f68-bf32-89a546fce2b5 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] [instance: 7c191ac7-443c-460d-88b3-5d49f5f733c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='add1979e-0a3b-4403-a8ae-8d9a7b045fc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 03:57:50.736382 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-d72318d3-54e8-4845-b7c1-7c53c6fa3a5c tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:50.744116 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-d72318d3-54e8-4845-b7c1-7c53c6fa3a5c tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca" status: 200 len: 1367 microversion: 2.1 time: 0.170227 Oct 17 03:57:50.744710 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 322/642] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:50 2022] GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:57:50.795925 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-5bae44dc-84c4-4da7-ad14-3ca7342f6c76 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:50.796456 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-5bae44dc-84c4-4da7-ad14-3ca7342f6c76 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 57546995-2ef9-4773-a47a-13cbd2a831a9] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:50.802247 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-5bae44dc-84c4-4da7-ad14-3ca7342f6c76 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:50.802731 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-5bae44dc-84c4-4da7-ad14-3ca7342f6c76 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:50.803166 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-5bae44dc-84c4-4da7-ad14-3ca7342f6c76 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:50.803886 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-5bae44dc-84c4-4da7-ad14-3ca7342f6c76 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:50.804342 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-5bae44dc-84c4-4da7-ad14-3ca7342f6c76 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:50.804766 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-5bae44dc-84c4-4da7-ad14-3ca7342f6c76 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:50.825120 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-7525510a-0fad-4f68-bf32-89a546fce2b5 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.607206 Oct 17 03:57:50.826025 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 321/643] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 17 03:57:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 03:57:50.837212 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-b61b61ea-8b9c-40b3-bfd9-d501c99e4be6 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:50.837824 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-b61b61ea-8b9c-40b3-bfd9-d501c99e4be6 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] [instance: 7c191ac7-443c-460d-88b3-5d49f5f733c7] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:50.905314 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-b61b61ea-8b9c-40b3-bfd9-d501c99e4be6 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ffc76632a456d9e833381783d4dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed59353a4741cbb901808f7d2210d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:50.914786 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-b61b61ea-8b9c-40b3-bfd9-d501c99e4be6 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] 10.222.0.16 "GET /compute/v2.1/servers/7c191ac7-443c-460d-88b3-5d49f5f733c7" status: 200 len: 1219 microversion: 2.1 time: 0.080771 Oct 17 03:57:50.919279 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 322/644] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:50 2022] GET /compute/v2.1/servers/7c191ac7-443c-460d-88b3-5d49f5f733c7 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:50.957591 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-5bae44dc-84c4-4da7-ad14-3ca7342f6c76 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:50.966669 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-5bae44dc-84c4-4da7-ad14-3ca7342f6c76 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9" status: 200 len: 1724 microversion: 2.1 time: 0.174592 Oct 17 03:57:50.971218 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 323/645] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:50 2022] GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:57:51.175785 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-404f340c-fcb9-4f4d-b66c-46d49be926a6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:51.176502 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-404f340c-fcb9-4f4d-b66c-46d49be926a6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:51.184332 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-404f340c-fcb9-4f4d-b66c-46d49be926a6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:51.185115 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-404f340c-fcb9-4f4d-b66c-46d49be926a6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:51.185609 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-404f340c-fcb9-4f4d-b66c-46d49be926a6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:51.186377 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-404f340c-fcb9-4f4d-b66c-46d49be926a6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:51.186946 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-404f340c-fcb9-4f4d-b66c-46d49be926a6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:51.187439 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-404f340c-fcb9-4f4d-b66c-46d49be926a6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:51.333211 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-404f340c-fcb9-4f4d-b66c-46d49be926a6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:51.342167 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-404f340c-fcb9-4f4d-b66c-46d49be926a6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:51.343702 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-404f340c-fcb9-4f4d-b66c-46d49be926a6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:51.344862 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-404f340c-fcb9-4f4d-b66c-46d49be926a6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1808 microversion: 2.20 time: 0.173347 Oct 17 03:57:51.345425 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 323/646] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:57:51 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:57:51.369058 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [req-6fef5934-59ec-4aec-bd21-3a988b1a541d req-ebbbcb16-4bb2-4701-84ac-c63114a266fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dabcc62-4829-4f97-830f-e82af447faca", "name": "network-vif-plugged", "status": "completed", "tag": "75567cd8-4940-4ce0-8d82-997c7cc06bc0"}]} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:57:51.379854 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-6fef5934-59ec-4aec-bd21-3a988b1a541d req-ebbbcb16-4bb2-4701-84ac-c63114a266fb service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:51.380333 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-6fef5934-59ec-4aec-bd21-3a988b1a541d req-ebbbcb16-4bb2-4701-84ac-c63114a266fb service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:51.380764 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-6fef5934-59ec-4aec-bd21-3a988b1a541d req-ebbbcb16-4bb2-4701-84ac-c63114a266fb service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:51.392748 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.compute.server_external_events [req-6fef5934-59ec-4aec-bd21-3a988b1a541d req-ebbbcb16-4bb2-4701-84ac-c63114a266fb service nova] Creating event network-vif-plugged:75567cd8-4940-4ce0-8d82-997c7cc06bc0 for instance 6dabcc62-4829-4f97-830f-e82af447faca on hv-cinder-81558 Oct 17 03:57:51.397563 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [req-6fef5934-59ec-4aec-bd21-3a988b1a541d req-ebbbcb16-4bb2-4701-84ac-c63114a266fb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032176 Oct 17 03:57:51.398153 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 324/647] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 03:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:57:51.766196 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-d3b45621-71f1-4fe9-bb05-efaf5b2e29c9 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:51.766817 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-d3b45621-71f1-4fe9-bb05-efaf5b2e29c9 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 6dabcc62-4829-4f97-830f-e82af447faca] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:51.772891 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d3b45621-71f1-4fe9-bb05-efaf5b2e29c9 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:51.773374 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d3b45621-71f1-4fe9-bb05-efaf5b2e29c9 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:51.773809 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d3b45621-71f1-4fe9-bb05-efaf5b2e29c9 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:51.774530 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d3b45621-71f1-4fe9-bb05-efaf5b2e29c9 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:51.774984 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d3b45621-71f1-4fe9-bb05-efaf5b2e29c9 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:51.775436 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d3b45621-71f1-4fe9-bb05-efaf5b2e29c9 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:51.942038 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-000bbce2-c553-4b42-a167-cc8b587dffc0 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:51.943545 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-000bbce2-c553-4b42-a167-cc8b587dffc0 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] [instance: 7c191ac7-443c-460d-88b3-5d49f5f733c7] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:51.954463 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-000bbce2-c553-4b42-a167-cc8b587dffc0 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:51.959805 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-000bbce2-c553-4b42-a167-cc8b587dffc0 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:51.960746 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-000bbce2-c553-4b42-a167-cc8b587dffc0 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:51.963637 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-000bbce2-c553-4b42-a167-cc8b587dffc0 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:51.964146 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-000bbce2-c553-4b42-a167-cc8b587dffc0 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:51.964591 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-000bbce2-c553-4b42-a167-cc8b587dffc0 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:52.032398 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-000bbce2-c553-4b42-a167-cc8b587dffc0 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ffc76632a456d9e833381783d4dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed59353a4741cbb901808f7d2210d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:52.041956 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-000bbce2-c553-4b42-a167-cc8b587dffc0 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] 10.222.0.16 "GET /compute/v2.1/servers/7c191ac7-443c-460d-88b3-5d49f5f733c7" status: 200 len: 1223 microversion: 2.1 time: 0.106132 Oct 17 03:57:52.043305 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 325/648] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:51 2022] GET /compute/v2.1/servers/7c191ac7-443c-460d-88b3-5d49f5f733c7 => generated 1223 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:52.048483 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-df76d53b-a89d-4711-87cb-2ccd518654b3 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:52.049755 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-df76d53b-a89d-4711-87cb-2ccd518654b3 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 57546995-2ef9-4773-a47a-13cbd2a831a9] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:52.055774 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-df76d53b-a89d-4711-87cb-2ccd518654b3 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:52.056262 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-df76d53b-a89d-4711-87cb-2ccd518654b3 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:52.056693 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-df76d53b-a89d-4711-87cb-2ccd518654b3 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:52.057390 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-df76d53b-a89d-4711-87cb-2ccd518654b3 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:52.057848 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-df76d53b-a89d-4711-87cb-2ccd518654b3 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:52.058269 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-df76d53b-a89d-4711-87cb-2ccd518654b3 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:52.179949 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-d3b45621-71f1-4fe9-bb05-efaf5b2e29c9 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:52.188312 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-d3b45621-71f1-4fe9-bb05-efaf5b2e29c9 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca" status: 200 len: 1367 microversion: 2.1 time: 0.425726 Oct 17 03:57:52.188909 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 324/649] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:51 2022] GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca => generated 1367 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:52.214837 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-df76d53b-a89d-4711-87cb-2ccd518654b3 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:52.224309 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-df76d53b-a89d-4711-87cb-2ccd518654b3 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9" status: 200 len: 1724 microversion: 2.1 time: 0.179511 Oct 17 03:57:52.224891 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 326/650] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:52 2022] GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:52.369507 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-829ad339-ee9d-4619-9e1d-9a6f7e9a1707 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:52.370043 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-829ad339-ee9d-4619-9e1d-9a6f7e9a1707 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:52.376610 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-829ad339-ee9d-4619-9e1d-9a6f7e9a1707 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:52.377076 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-829ad339-ee9d-4619-9e1d-9a6f7e9a1707 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:52.377516 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-829ad339-ee9d-4619-9e1d-9a6f7e9a1707 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:52.378208 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-829ad339-ee9d-4619-9e1d-9a6f7e9a1707 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:52.378661 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-829ad339-ee9d-4619-9e1d-9a6f7e9a1707 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:52.379086 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-829ad339-ee9d-4619-9e1d-9a6f7e9a1707 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:52.505738 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-829ad339-ee9d-4619-9e1d-9a6f7e9a1707 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:52.515003 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-829ad339-ee9d-4619-9e1d-9a6f7e9a1707 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:52.516473 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-829ad339-ee9d-4619-9e1d-9a6f7e9a1707 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:52.517629 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-829ad339-ee9d-4619-9e1d-9a6f7e9a1707 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1795 microversion: 2.20 time: 0.152239 Oct 17 03:57:52.518188 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 325/651] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:57:52 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1795 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:57:53.065291 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-2f7d0a60-5785-450c-a878-01470a23107d tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:53.065908 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-2f7d0a60-5785-450c-a878-01470a23107d tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] [instance: 7c191ac7-443c-460d-88b3-5d49f5f733c7] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:53.072427 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2f7d0a60-5785-450c-a878-01470a23107d tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:53.074699 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2f7d0a60-5785-450c-a878-01470a23107d tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:53.075147 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2f7d0a60-5785-450c-a878-01470a23107d tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:53.076316 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2f7d0a60-5785-450c-a878-01470a23107d tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:53.076924 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2f7d0a60-5785-450c-a878-01470a23107d tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:53.078308 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2f7d0a60-5785-450c-a878-01470a23107d tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:53.140395 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-2f7d0a60-5785-450c-a878-01470a23107d tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ffc76632a456d9e833381783d4dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed59353a4741cbb901808f7d2210d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:53.147914 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-2f7d0a60-5785-450c-a878-01470a23107d tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] 10.222.0.16 "GET /compute/v2.1/servers/7c191ac7-443c-460d-88b3-5d49f5f733c7" status: 200 len: 1215 microversion: 2.1 time: 0.086462 Oct 17 03:57:53.148482 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 327/652] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:53 2022] GET /compute/v2.1/servers/7c191ac7-443c-460d-88b3-5d49f5f733c7 => generated 1215 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:53.211453 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-6d88926e-639e-4484-9f63-0e2574a98ea7 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:53.212211 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-6d88926e-639e-4484-9f63-0e2574a98ea7 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 6dabcc62-4829-4f97-830f-e82af447faca] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:53.218136 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-6d88926e-639e-4484-9f63-0e2574a98ea7 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:53.218617 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-6d88926e-639e-4484-9f63-0e2574a98ea7 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:53.219049 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-6d88926e-639e-4484-9f63-0e2574a98ea7 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:53.219777 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-6d88926e-639e-4484-9f63-0e2574a98ea7 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:53.220234 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-6d88926e-639e-4484-9f63-0e2574a98ea7 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:53.220658 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-6d88926e-639e-4484-9f63-0e2574a98ea7 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:53.248281 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-e270777e-8817-45e9-a48f-9efc012ba267 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:53.248892 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-e270777e-8817-45e9-a48f-9efc012ba267 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 57546995-2ef9-4773-a47a-13cbd2a831a9] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:53.254997 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e270777e-8817-45e9-a48f-9efc012ba267 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:53.255552 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e270777e-8817-45e9-a48f-9efc012ba267 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:53.255982 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e270777e-8817-45e9-a48f-9efc012ba267 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:53.256670 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e270777e-8817-45e9-a48f-9efc012ba267 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:53.257118 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e270777e-8817-45e9-a48f-9efc012ba267 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:53.257536 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e270777e-8817-45e9-a48f-9efc012ba267 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:53.348270 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-6d88926e-639e-4484-9f63-0e2574a98ea7 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:53.356307 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-6d88926e-639e-4484-9f63-0e2574a98ea7 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca" status: 200 len: 1367 microversion: 2.1 time: 0.148778 Oct 17 03:57:53.356876 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 326/653] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:53 2022] GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:53.386701 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-e270777e-8817-45e9-a48f-9efc012ba267 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:53.394765 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-e270777e-8817-45e9-a48f-9efc012ba267 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9" status: 200 len: 1730 microversion: 2.1 time: 0.150942 Oct 17 03:57:53.395356 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 328/654] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:53 2022] GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:57:53.418329 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-500b65de-7ca8-4576-93e5-04e3217f04ab tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:53.418829 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-500b65de-7ca8-4576-93e5-04e3217f04ab tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 57546995-2ef9-4773-a47a-13cbd2a831a9] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:53.425074 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-500b65de-7ca8-4576-93e5-04e3217f04ab tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:53.425552 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-500b65de-7ca8-4576-93e5-04e3217f04ab tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:53.425983 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-500b65de-7ca8-4576-93e5-04e3217f04ab tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:53.426665 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-500b65de-7ca8-4576-93e5-04e3217f04ab tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:53.427113 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-500b65de-7ca8-4576-93e5-04e3217f04ab tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:53.427627 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-500b65de-7ca8-4576-93e5-04e3217f04ab tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:53.502523 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-500b65de-7ca8-4576-93e5-04e3217f04ab tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088851 Oct 17 03:57:53.503120 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 327/655] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Oct 17 03:57:53 2022] GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:57:54.170129 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-e6b6d62e-da5f-42fb-a35a-c5285516150b tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:54.171477 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-e6b6d62e-da5f-42fb-a35a-c5285516150b tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] [instance: 7c191ac7-443c-460d-88b3-5d49f5f733c7] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:54.178015 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e6b6d62e-da5f-42fb-a35a-c5285516150b tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:54.178498 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e6b6d62e-da5f-42fb-a35a-c5285516150b tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:54.178933 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e6b6d62e-da5f-42fb-a35a-c5285516150b tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:54.179658 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e6b6d62e-da5f-42fb-a35a-c5285516150b tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:54.180185 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e6b6d62e-da5f-42fb-a35a-c5285516150b tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:54.180635 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e6b6d62e-da5f-42fb-a35a-c5285516150b tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:54.248172 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-e6b6d62e-da5f-42fb-a35a-c5285516150b tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ffc76632a456d9e833381783d4dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed59353a4741cbb901808f7d2210d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:54.256381 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-e6b6d62e-da5f-42fb-a35a-c5285516150b tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] 10.222.0.16 "GET /compute/v2.1/servers/7c191ac7-443c-460d-88b3-5d49f5f733c7" status: 200 len: 1271 microversion: 2.1 time: 0.090184 Oct 17 03:57:54.256957 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 329/656] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:54 2022] GET /compute/v2.1/servers/7c191ac7-443c-460d-88b3-5d49f5f733c7 => generated 1271 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:57:54.378294 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-8586f59c-e4ee-475a-890b-1a34258a9702 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:54.379014 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-8586f59c-e4ee-475a-890b-1a34258a9702 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 6dabcc62-4829-4f97-830f-e82af447faca] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:54.386032 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8586f59c-e4ee-475a-890b-1a34258a9702 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:54.386516 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8586f59c-e4ee-475a-890b-1a34258a9702 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:54.386954 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8586f59c-e4ee-475a-890b-1a34258a9702 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:54.387687 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8586f59c-e4ee-475a-890b-1a34258a9702 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:54.388317 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8586f59c-e4ee-475a-890b-1a34258a9702 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:54.388739 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8586f59c-e4ee-475a-890b-1a34258a9702 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:54.516529 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [req-c5c04bff-1823-4fec-9319-13867e67b1e7 req-0a908ae0-cb77-4c25-8b36-668cf6f65fc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57546995-2ef9-4773-a47a-13cbd2a831a9", "tag": "6d4fd674-8999-42dd-8bcb-abfcc7aaca39"}]} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:57:54.527382 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-c5c04bff-1823-4fec-9319-13867e67b1e7 req-0a908ae0-cb77-4c25-8b36-668cf6f65fc2 service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:54.528147 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-c5c04bff-1823-4fec-9319-13867e67b1e7 req-0a908ae0-cb77-4c25-8b36-668cf6f65fc2 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:54.528740 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-c5c04bff-1823-4fec-9319-13867e67b1e7 req-0a908ae0-cb77-4c25-8b36-668cf6f65fc2 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:54.544039 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.compute.server_external_events [req-c5c04bff-1823-4fec-9319-13867e67b1e7 req-0a908ae0-cb77-4c25-8b36-668cf6f65fc2 service nova] Creating event network-changed:6d4fd674-8999-42dd-8bcb-abfcc7aaca39 for instance 57546995-2ef9-4773-a47a-13cbd2a831a9 on hv-cinder-81558 Oct 17 03:57:54.560045 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [req-c5c04bff-1823-4fec-9319-13867e67b1e7 req-0a908ae0-cb77-4c25-8b36-668cf6f65fc2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043043 Oct 17 03:57:54.560045 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 330/657] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 03:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 03:57:54.746120 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-8586f59c-e4ee-475a-890b-1a34258a9702 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:54.765156 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-8586f59c-e4ee-475a-890b-1a34258a9702 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca" status: 200 len: 1557 microversion: 2.1 time: 0.390890 Oct 17 03:57:54.767611 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 328/658] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:54 2022] GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca => generated 1557 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:54.794822 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-f02fc92b-89d4-4d32-a4a3-dc6c5fbe66ae tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:54.795344 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-f02fc92b-89d4-4d32-a4a3-dc6c5fbe66ae tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 6dabcc62-4829-4f97-830f-e82af447faca] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:54.809976 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f02fc92b-89d4-4d32-a4a3-dc6c5fbe66ae tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:54.810967 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f02fc92b-89d4-4d32-a4a3-dc6c5fbe66ae tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:54.819957 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f02fc92b-89d4-4d32-a4a3-dc6c5fbe66ae tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:54.819957 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f02fc92b-89d4-4d32-a4a3-dc6c5fbe66ae tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:54.819957 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f02fc92b-89d4-4d32-a4a3-dc6c5fbe66ae tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:54.819957 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f02fc92b-89d4-4d32-a4a3-dc6c5fbe66ae tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:54.945022 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-f02fc92b-89d4-4d32-a4a3-dc6c5fbe66ae tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.156593 Oct 17 03:57:54.946392 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 331/659] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Oct 17 03:57:54 2022] GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca/os-interface => generated 284 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:57:55.282507 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-ec35a853-f2cd-4b42-85ee-777bb4249dd6 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:55.283365 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-ec35a853-f2cd-4b42-85ee-777bb4249dd6 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] [instance: 7c191ac7-443c-460d-88b3-5d49f5f733c7] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:55.295684 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ec35a853-f2cd-4b42-85ee-777bb4249dd6 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:55.296222 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ec35a853-f2cd-4b42-85ee-777bb4249dd6 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:55.296626 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ec35a853-f2cd-4b42-85ee-777bb4249dd6 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:55.297341 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ec35a853-f2cd-4b42-85ee-777bb4249dd6 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:55.297798 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ec35a853-f2cd-4b42-85ee-777bb4249dd6 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:55.300767 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ec35a853-f2cd-4b42-85ee-777bb4249dd6 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:55.441141 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-ec35a853-f2cd-4b42-85ee-777bb4249dd6 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ffc76632a456d9e833381783d4dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed59353a4741cbb901808f7d2210d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:55.452703 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-ec35a853-f2cd-4b42-85ee-777bb4249dd6 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] 10.222.0.16 "GET /compute/v2.1/servers/7c191ac7-443c-460d-88b3-5d49f5f733c7" status: 200 len: 1271 microversion: 2.1 time: 0.175584 Oct 17 03:57:55.454183 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 329/660] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:55 2022] GET /compute/v2.1/servers/7c191ac7-443c-460d-88b3-5d49f5f733c7 => generated 1271 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:56.478679 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-b2b76f62-dc8f-4f9c-84c3-b47a68cd4470 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:56.480519 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-b2b76f62-dc8f-4f9c-84c3-b47a68cd4470 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] [instance: 7c191ac7-443c-460d-88b3-5d49f5f733c7] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:56.486950 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b2b76f62-dc8f-4f9c-84c3-b47a68cd4470 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:56.487813 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b2b76f62-dc8f-4f9c-84c3-b47a68cd4470 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:56.488257 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b2b76f62-dc8f-4f9c-84c3-b47a68cd4470 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:56.488961 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b2b76f62-dc8f-4f9c-84c3-b47a68cd4470 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:56.489412 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b2b76f62-dc8f-4f9c-84c3-b47a68cd4470 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:56.490119 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b2b76f62-dc8f-4f9c-84c3-b47a68cd4470 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:56.511907 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [req-984ae637-1825-4188-9183-fa16d3e5da0f req-74a8ae6a-f90f-4312-83ec-985b621b38d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dabcc62-4829-4f97-830f-e82af447faca", "tag": "75567cd8-4940-4ce0-8d82-997c7cc06bc0"}]} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:57:56.526166 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-984ae637-1825-4188-9183-fa16d3e5da0f req-74a8ae6a-f90f-4312-83ec-985b621b38d1 service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:56.526656 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-984ae637-1825-4188-9183-fa16d3e5da0f req-74a8ae6a-f90f-4312-83ec-985b621b38d1 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:56.527095 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-984ae637-1825-4188-9183-fa16d3e5da0f req-74a8ae6a-f90f-4312-83ec-985b621b38d1 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:56.545030 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.compute.server_external_events [req-984ae637-1825-4188-9183-fa16d3e5da0f req-74a8ae6a-f90f-4312-83ec-985b621b38d1 service nova] Creating event network-changed:75567cd8-4940-4ce0-8d82-997c7cc06bc0 for instance 6dabcc62-4829-4f97-830f-e82af447faca on hv-cinder-81558 Oct 17 03:57:56.550182 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [req-984ae637-1825-4188-9183-fa16d3e5da0f req-74a8ae6a-f90f-4312-83ec-985b621b38d1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042162 Oct 17 03:57:56.550793 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 330/661] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 03:57:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:57:56.579073 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [req-6f70947d-f70d-40a7-84d1-07f885e4cfe4 req-ec8988de-febd-442b-b183-028642379678 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57546995-2ef9-4773-a47a-13cbd2a831a9", "tag": "6d4fd674-8999-42dd-8bcb-abfcc7aaca39"}]} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:57:56.589834 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-b2b76f62-dc8f-4f9c-84c3-b47a68cd4470 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ffc76632a456d9e833381783d4dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed59353a4741cbb901808f7d2210d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:56.592204 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-6f70947d-f70d-40a7-84d1-07f885e4cfe4 req-ec8988de-febd-442b-b183-028642379678 service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:56.592915 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-6f70947d-f70d-40a7-84d1-07f885e4cfe4 req-ec8988de-febd-442b-b183-028642379678 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:56.593587 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-6f70947d-f70d-40a7-84d1-07f885e4cfe4 req-ec8988de-febd-442b-b183-028642379678 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:56.607793 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.compute.server_external_events [req-6f70947d-f70d-40a7-84d1-07f885e4cfe4 req-ec8988de-febd-442b-b183-028642379678 service nova] Creating event network-changed:6d4fd674-8999-42dd-8bcb-abfcc7aaca39 for instance 57546995-2ef9-4773-a47a-13cbd2a831a9 on hv-cinder-81558 Oct 17 03:57:56.613292 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [req-6f70947d-f70d-40a7-84d1-07f885e4cfe4 req-ec8988de-febd-442b-b183-028642379678 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039673 Oct 17 03:57:56.614425 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 331/662] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 03:57:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 03:57:56.615806 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-b2b76f62-dc8f-4f9c-84c3-b47a68cd4470 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] 10.222.0.16 "GET /compute/v2.1/servers/7c191ac7-443c-460d-88b3-5d49f5f733c7" status: 200 len: 1277 microversion: 2.1 time: 0.137453 Oct 17 03:57:56.628858 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 332/663] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:56 2022] GET /compute/v2.1/servers/7c191ac7-443c-460d-88b3-5d49f5f733c7 => generated 1277 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:57:57.642163 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-050c0d58-acba-4a8c-9b03-096b2cf1f5f9 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:57.642865 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-050c0d58-acba-4a8c-9b03-096b2cf1f5f9 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] [instance: 7c191ac7-443c-460d-88b3-5d49f5f733c7] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:57.649625 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-050c0d58-acba-4a8c-9b03-096b2cf1f5f9 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:57.650091 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-050c0d58-acba-4a8c-9b03-096b2cf1f5f9 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:57.655332 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-050c0d58-acba-4a8c-9b03-096b2cf1f5f9 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:57.655332 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-050c0d58-acba-4a8c-9b03-096b2cf1f5f9 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:57.655332 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-050c0d58-acba-4a8c-9b03-096b2cf1f5f9 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:57.655332 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-050c0d58-acba-4a8c-9b03-096b2cf1f5f9 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:57.857974 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-050c0d58-acba-4a8c-9b03-096b2cf1f5f9 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ffc76632a456d9e833381783d4dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed59353a4741cbb901808f7d2210d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:57.866610 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-050c0d58-acba-4a8c-9b03-096b2cf1f5f9 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] 10.222.0.16 "GET /compute/v2.1/servers/7c191ac7-443c-460d-88b3-5d49f5f733c7" status: 200 len: 1319 microversion: 2.1 time: 0.228735 Oct 17 03:57:57.867215 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 332/664] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:57 2022] GET /compute/v2.1/servers/7c191ac7-443c-460d-88b3-5d49f5f733c7 => generated 1319 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:57:58.574350 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [req-0a02cf21-9089-42cc-b24f-8a8cb28f2401 req-99bd4dd5-961a-46ec-b1bb-d0a6e7dc6fe3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c191ac7-443c-460d-88b3-5d49f5f733c7", "tag": "9cb8610b-332e-4113-9af2-0a44ec23e97b"}]} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:57:58.584247 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-0a02cf21-9089-42cc-b24f-8a8cb28f2401 req-99bd4dd5-961a-46ec-b1bb-d0a6e7dc6fe3 service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:58.584723 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-0a02cf21-9089-42cc-b24f-8a8cb28f2401 req-99bd4dd5-961a-46ec-b1bb-d0a6e7dc6fe3 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:58.590706 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-0a02cf21-9089-42cc-b24f-8a8cb28f2401 req-99bd4dd5-961a-46ec-b1bb-d0a6e7dc6fe3 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:58.596028 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.compute.server_external_events [req-0a02cf21-9089-42cc-b24f-8a8cb28f2401 req-99bd4dd5-961a-46ec-b1bb-d0a6e7dc6fe3 service nova] Creating event network-changed:9cb8610b-332e-4113-9af2-0a44ec23e97b for instance 7c191ac7-443c-460d-88b3-5d49f5f733c7 on hv-cinder-81558 Oct 17 03:57:58.600721 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [req-0a02cf21-9089-42cc-b24f-8a8cb28f2401 req-99bd4dd5-961a-46ec-b1bb-d0a6e7dc6fe3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030696 Oct 17 03:57:58.601303 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 333/665] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 03:57:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:57:58.889787 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-d7523e64-9e74-48e5-85e9-f76abc595c3b tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:57:58.890404 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-d7523e64-9e74-48e5-85e9-f76abc595c3b tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] [instance: 7c191ac7-443c-460d-88b3-5d49f5f733c7] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:57:58.896896 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d7523e64-9e74-48e5-85e9-f76abc595c3b tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:58.897376 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d7523e64-9e74-48e5-85e9-f76abc595c3b tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:58.897813 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d7523e64-9e74-48e5-85e9-f76abc595c3b tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:58.898499 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d7523e64-9e74-48e5-85e9-f76abc595c3b tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:57:58.898956 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d7523e64-9e74-48e5-85e9-f76abc595c3b tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:57:58.899405 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d7523e64-9e74-48e5-85e9-f76abc595c3b tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:57:59.026405 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-d7523e64-9e74-48e5-85e9-f76abc595c3b tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ffc76632a456d9e833381783d4dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed59353a4741cbb901808f7d2210d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:57:59.033903 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-d7523e64-9e74-48e5-85e9-f76abc595c3b tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] 10.222.0.16 "GET /compute/v2.1/servers/7c191ac7-443c-460d-88b3-5d49f5f733c7" status: 200 len: 1319 microversion: 2.1 time: 0.148861 Oct 17 03:57:59.034473 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 333/666] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:57:58 2022] GET /compute/v2.1/servers/7c191ac7-443c-460d-88b3-5d49f5f733c7 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:58:00.058422 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-fb547755-b207-467d-b147-27823909c9c0 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:00.059129 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-fb547755-b207-467d-b147-27823909c9c0 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] [instance: 7c191ac7-443c-460d-88b3-5d49f5f733c7] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:00.065222 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-fb547755-b207-467d-b147-27823909c9c0 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:00.065702 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-fb547755-b207-467d-b147-27823909c9c0 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:00.066139 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-fb547755-b207-467d-b147-27823909c9c0 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:00.066828 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-fb547755-b207-467d-b147-27823909c9c0 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:00.067318 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-fb547755-b207-467d-b147-27823909c9c0 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:00.067768 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-fb547755-b207-467d-b147-27823909c9c0 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:00.198738 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-fb547755-b207-467d-b147-27823909c9c0 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ffc76632a456d9e833381783d4dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed59353a4741cbb901808f7d2210d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:00.206527 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-fb547755-b207-467d-b147-27823909c9c0 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] 10.222.0.16 "GET /compute/v2.1/servers/7c191ac7-443c-460d-88b3-5d49f5f733c7" status: 200 len: 1319 microversion: 2.1 time: 0.153059 Oct 17 03:58:00.206824 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 334/667] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:58:00 2022] GET /compute/v2.1/servers/7c191ac7-443c-460d-88b3-5d49f5f733c7 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:58:01.229900 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-ff0624d1-7706-463c-a962-2d8262de5ab4 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:01.230546 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-ff0624d1-7706-463c-a962-2d8262de5ab4 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] [instance: 7c191ac7-443c-460d-88b3-5d49f5f733c7] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:01.234008 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_cell0:SELECT=2 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:58:01.235279 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_cell0:SELECT=8 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:58:01.238642 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ff0624d1-7706-463c-a962-2d8262de5ab4 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:01.239142 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ff0624d1-7706-463c-a962-2d8262de5ab4 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:01.239598 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ff0624d1-7706-463c-a962-2d8262de5ab4 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:01.240320 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ff0624d1-7706-463c-a962-2d8262de5ab4 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:01.240782 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ff0624d1-7706-463c-a962-2d8262de5ab4 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:01.241200 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ff0624d1-7706-463c-a962-2d8262de5ab4 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:01.245834 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:58:01.376936 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-ff0624d1-7706-463c-a962-2d8262de5ab4 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ffc76632a456d9e833381783d4dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed59353a4741cbb901808f7d2210d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:01.385158 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-ff0624d1-7706-463c-a962-2d8262de5ab4 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] 10.222.0.16 "GET /compute/v2.1/servers/7c191ac7-443c-460d-88b3-5d49f5f733c7" status: 200 len: 1319 microversion: 2.1 time: 0.159600 Oct 17 03:58:01.385728 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 334/668] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:58:01 2022] GET /compute/v2.1/servers/7c191ac7-443c-460d-88b3-5d49f5f733c7 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:58:02.407225 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-24ef6849-ad58-449e-b2c1-579b7ea309c4 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:02.407850 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-24ef6849-ad58-449e-b2c1-579b7ea309c4 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] [instance: 7c191ac7-443c-460d-88b3-5d49f5f733c7] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:02.410314 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_api:SELECT=100 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:58:02.415061 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-24ef6849-ad58-449e-b2c1-579b7ea309c4 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:02.415591 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-24ef6849-ad58-449e-b2c1-579b7ea309c4 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:02.416031 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-24ef6849-ad58-449e-b2c1-579b7ea309c4 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:02.416736 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-24ef6849-ad58-449e-b2c1-579b7ea309c4 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:02.417192 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-24ef6849-ad58-449e-b2c1-579b7ea309c4 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:02.417621 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-24ef6849-ad58-449e-b2c1-579b7ea309c4 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:02.543329 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-24ef6849-ad58-449e-b2c1-579b7ea309c4 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ffc76632a456d9e833381783d4dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed59353a4741cbb901808f7d2210d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:02.550954 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-24ef6849-ad58-449e-b2c1-579b7ea309c4 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] 10.222.0.16 "GET /compute/v2.1/servers/7c191ac7-443c-460d-88b3-5d49f5f733c7" status: 200 len: 1319 microversion: 2.1 time: 0.147654 Oct 17 03:58:02.555569 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 335/669] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:58:02 2022] GET /compute/v2.1/servers/7c191ac7-443c-460d-88b3-5d49f5f733c7 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:58:03.427539 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [req-8ffdf137-973c-4800-a9f7-690953600b0f req-a441fe89-8814-47da-bd8b-86a93de94e1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c191ac7-443c-460d-88b3-5d49f5f733c7", "name": "network-vif-plugged", "status": "completed", "tag": "9cb8610b-332e-4113-9af2-0a44ec23e97b"}]} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:58:03.438474 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-8ffdf137-973c-4800-a9f7-690953600b0f req-a441fe89-8814-47da-bd8b-86a93de94e1b service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:03.438959 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-8ffdf137-973c-4800-a9f7-690953600b0f req-a441fe89-8814-47da-bd8b-86a93de94e1b service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:03.439426 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-8ffdf137-973c-4800-a9f7-690953600b0f req-a441fe89-8814-47da-bd8b-86a93de94e1b service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:03.450242 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.compute.server_external_events [req-8ffdf137-973c-4800-a9f7-690953600b0f req-a441fe89-8814-47da-bd8b-86a93de94e1b service nova] Creating event network-vif-plugged:9cb8610b-332e-4113-9af2-0a44ec23e97b for instance 7c191ac7-443c-460d-88b3-5d49f5f733c7 on hv-cinder-81558 Oct 17 03:58:03.454942 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [req-8ffdf137-973c-4800-a9f7-690953600b0f req-a441fe89-8814-47da-bd8b-86a93de94e1b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031579 Oct 17 03:58:03.455551 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 335/670] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 03:58:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:58:03.573969 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-ce88ed30-a8bb-4b74-9ea1-c4b591198a31 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:03.574591 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-ce88ed30-a8bb-4b74-9ea1-c4b591198a31 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] [instance: 7c191ac7-443c-460d-88b3-5d49f5f733c7] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:03.581226 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ce88ed30-a8bb-4b74-9ea1-c4b591198a31 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:03.581713 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ce88ed30-a8bb-4b74-9ea1-c4b591198a31 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:03.582151 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ce88ed30-a8bb-4b74-9ea1-c4b591198a31 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:03.582850 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ce88ed30-a8bb-4b74-9ea1-c4b591198a31 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:03.583339 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ce88ed30-a8bb-4b74-9ea1-c4b591198a31 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:03.583814 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ce88ed30-a8bb-4b74-9ea1-c4b591198a31 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:03.603190 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_cell1:SELECT=100 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:58:03.712832 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-ce88ed30-a8bb-4b74-9ea1-c4b591198a31 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ffc76632a456d9e833381783d4dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed59353a4741cbb901808f7d2210d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:03.720447 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-ce88ed30-a8bb-4b74-9ea1-c4b591198a31 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] 10.222.0.16 "GET /compute/v2.1/servers/7c191ac7-443c-460d-88b3-5d49f5f733c7" status: 200 len: 1319 microversion: 2.1 time: 0.150451 Oct 17 03:58:03.721013 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 336/671] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:58:03 2022] GET /compute/v2.1/servers/7c191ac7-443c-460d-88b3-5d49f5f733c7 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:58:04.744816 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-ab883698-a77a-4867-8231-557689bc9fe9 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:04.745520 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-ab883698-a77a-4867-8231-557689bc9fe9 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] [instance: 7c191ac7-443c-460d-88b3-5d49f5f733c7] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:04.751793 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ab883698-a77a-4867-8231-557689bc9fe9 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:04.752283 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ab883698-a77a-4867-8231-557689bc9fe9 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:04.752720 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ab883698-a77a-4867-8231-557689bc9fe9 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:04.753422 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ab883698-a77a-4867-8231-557689bc9fe9 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:04.753877 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ab883698-a77a-4867-8231-557689bc9fe9 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:04.754303 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ab883698-a77a-4867-8231-557689bc9fe9 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:04.880753 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-ab883698-a77a-4867-8231-557689bc9fe9 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ffc76632a456d9e833381783d4dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed59353a4741cbb901808f7d2210d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:04.889140 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-ab883698-a77a-4867-8231-557689bc9fe9 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] 10.222.0.16 "GET /compute/v2.1/servers/7c191ac7-443c-460d-88b3-5d49f5f733c7" status: 200 len: 1319 microversion: 2.1 time: 0.149388 Oct 17 03:58:04.889704 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 336/672] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:58:04 2022] GET /compute/v2.1/servers/7c191ac7-443c-460d-88b3-5d49f5f733c7 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:58:05.911958 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-3e3907c9-acb7-4fc3-b5d7-56af88db9d81 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:05.912686 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-3e3907c9-acb7-4fc3-b5d7-56af88db9d81 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] [instance: 7c191ac7-443c-460d-88b3-5d49f5f733c7] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:05.919759 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-3e3907c9-acb7-4fc3-b5d7-56af88db9d81 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:05.920312 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-3e3907c9-acb7-4fc3-b5d7-56af88db9d81 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:05.920680 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-3e3907c9-acb7-4fc3-b5d7-56af88db9d81 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:05.921375 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-3e3907c9-acb7-4fc3-b5d7-56af88db9d81 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:05.921829 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-3e3907c9-acb7-4fc3-b5d7-56af88db9d81 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:05.922252 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-3e3907c9-acb7-4fc3-b5d7-56af88db9d81 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:06.054249 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-3e3907c9-acb7-4fc3-b5d7-56af88db9d81 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ffc76632a456d9e833381783d4dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed59353a4741cbb901808f7d2210d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:06.061934 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-3e3907c9-acb7-4fc3-b5d7-56af88db9d81 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] 10.222.0.16 "GET /compute/v2.1/servers/7c191ac7-443c-460d-88b3-5d49f5f733c7" status: 200 len: 1508 microversion: 2.1 time: 0.153886 Oct 17 03:58:06.062509 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 337/673] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:58:05 2022] GET /compute/v2.1/servers/7c191ac7-443c-460d-88b3-5d49f5f733c7 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:58:06.084134 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-3a7161f1-111c-4c56-ad51-81cd5038dddf tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cf335981-369b-41f9-bc5d-32f51c47da12", "device": "/dev/sdb"}} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:58:06.086571 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-3a7161f1-111c-4c56-ad51-81cd5038dddf tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] [instance: 7c191ac7-443c-460d-88b3-5d49f5f733c7] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:06.093457 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3a7161f1-111c-4c56-ad51-81cd5038dddf tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:06.093944 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3a7161f1-111c-4c56-ad51-81cd5038dddf tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:06.094386 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3a7161f1-111c-4c56-ad51-81cd5038dddf tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:06.095072 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3a7161f1-111c-4c56-ad51-81cd5038dddf tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:06.095562 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3a7161f1-111c-4c56-ad51-81cd5038dddf tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:06.095989 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3a7161f1-111c-4c56-ad51-81cd5038dddf tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:06.779746 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-3a7161f1-111c-4c56-ad51-81cd5038dddf tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] 10.222.0.16 "POST /compute/v2.1/servers/7c191ac7-443c-460d-88b3-5d49f5f733c7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.699214 Oct 17 03:58:06.780367 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 337/674] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Oct 17 03:58:06 2022] POST /compute/v2.1/servers/7c191ac7-443c-460d-88b3-5d49f5f733c7/os-volume_attachments => generated 194 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:58:09.833885 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [req-8304d805-241e-4dc7-9e70-68487799b07d req-51b4f4bc-323e-4268-be3a-0dc0833b9e38 admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "cf335981-369b-41f9-bc5d-32f51c47da12", "create_info": {"type": "qcow2", "new_file": "volume-cf335981-369b-41f9-bc5d-32f51c47da12.f976132c-0238-4e5f-ab0e-9cd01b292201.vhdx", "snapshot_id": "f976132c-0238-4e5f-ab0e-9cd01b292201"}}} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:58:09.837276 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-8304d805-241e-4dc7-9e70-68487799b07d req-51b4f4bc-323e-4268-be3a-0dc0833b9e38 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:09.837751 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-8304d805-241e-4dc7-9e70-68487799b07d req-51b4f4bc-323e-4268-be3a-0dc0833b9e38 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:09.838177 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-8304d805-241e-4dc7-9e70-68487799b07d req-51b4f4bc-323e-4268-be3a-0dc0833b9e38 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:09.846237 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-8304d805-241e-4dc7-9e70-68487799b07d req-51b4f4bc-323e-4268-be3a-0dc0833b9e38 admin admin] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:09.846699 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-8304d805-241e-4dc7-9e70-68487799b07d req-51b4f4bc-323e-4268-be3a-0dc0833b9e38 admin admin] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:09.847121 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-8304d805-241e-4dc7-9e70-68487799b07d req-51b4f4bc-323e-4268-be3a-0dc0833b9e38 admin admin] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:09.860758 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [req-8304d805-241e-4dc7-9e70-68487799b07d req-51b4f4bc-323e-4268-be3a-0dc0833b9e38 admin admin] 10.222.0.43 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.082461 Oct 17 03:58:09.861349 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 338/675] 10.222.0.43 () {64 vars in 1326 bytes} [Mon Oct 17 03:58:09 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 03:58:13.365277 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [req-14bcd5b0-1277-4971-98e3-7412c0b1bbc4 req-66df9e5e-7faa-4bac-81ae-822c24acc225 admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "cf335981-369b-41f9-bc5d-32f51c47da12", "create_info": {"type": "qcow2", "new_file": "volume-cf335981-369b-41f9-bc5d-32f51c47da12.8e2dae48-28f7-4e0a-a200-a9856a2afce7.vhdx", "snapshot_id": "8e2dae48-28f7-4e0a-a200-a9856a2afce7"}}} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:58:13.368640 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-14bcd5b0-1277-4971-98e3-7412c0b1bbc4 req-66df9e5e-7faa-4bac-81ae-822c24acc225 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:13.369121 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-14bcd5b0-1277-4971-98e3-7412c0b1bbc4 req-66df9e5e-7faa-4bac-81ae-822c24acc225 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:13.369604 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-14bcd5b0-1277-4971-98e3-7412c0b1bbc4 req-66df9e5e-7faa-4bac-81ae-822c24acc225 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:13.378920 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-14bcd5b0-1277-4971-98e3-7412c0b1bbc4 req-66df9e5e-7faa-4bac-81ae-822c24acc225 admin admin] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:13.379558 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-14bcd5b0-1277-4971-98e3-7412c0b1bbc4 req-66df9e5e-7faa-4bac-81ae-822c24acc225 admin admin] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:13.379989 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-14bcd5b0-1277-4971-98e3-7412c0b1bbc4 req-66df9e5e-7faa-4bac-81ae-822c24acc225 admin admin] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:13.393356 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [req-14bcd5b0-1277-4971-98e3-7412c0b1bbc4 req-66df9e5e-7faa-4bac-81ae-822c24acc225 admin admin] 10.222.0.43 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.081785 Oct 17 03:58:13.394243 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 338/676] 10.222.0.43 () {64 vars in 1326 bytes} [Mon Oct 17 03:58:13 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 03:58:13.890225 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-1238dd78-1da0-41f7-bfe4-a523cc170dcf tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:13.892670 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-1238dd78-1da0-41f7-bfe4-a523cc170dcf tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:13.899549 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1238dd78-1da0-41f7-bfe4-a523cc170dcf tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:13.900039 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1238dd78-1da0-41f7-bfe4-a523cc170dcf tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:13.900475 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1238dd78-1da0-41f7-bfe4-a523cc170dcf tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:13.901196 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1238dd78-1da0-41f7-bfe4-a523cc170dcf tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:13.901655 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1238dd78-1da0-41f7-bfe4-a523cc170dcf tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:13.902088 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1238dd78-1da0-41f7-bfe4-a523cc170dcf tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:13.930406 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-1238dd78-1da0-41f7-bfe4-a523cc170dcf tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045212 Oct 17 03:58:13.931032 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 339/677] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 17 03:58:13 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 03:58:13.993859 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-7fee9162-fd6f-45bb-94c3-916f454301d4 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:13.994452 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-7fee9162-fd6f-45bb-94c3-916f454301d4 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:13.997474 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:58:14.002371 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7fee9162-fd6f-45bb-94c3-916f454301d4 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:14.002857 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7fee9162-fd6f-45bb-94c3-916f454301d4 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:14.003337 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7fee9162-fd6f-45bb-94c3-916f454301d4 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:14.004037 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7fee9162-fd6f-45bb-94c3-916f454301d4 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:14.004502 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7fee9162-fd6f-45bb-94c3-916f454301d4 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:14.004932 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7fee9162-fd6f-45bb-94c3-916f454301d4 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:14.031627 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-7fee9162-fd6f-45bb-94c3-916f454301d4 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Going to try to terminate instance {{(pid=125871) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 03:58:14.314449 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-7fee9162-fd6f-45bb-94c3-916f454301d4 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 204 len: 0 microversion: 2.1 time: 0.324375 Oct 17 03:58:14.314982 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 339/678] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 17 03:58:13 2022] DELETE /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 03:58:14.323111 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-ff6abfe6-79ae-4b15-87cf-aa9378c712e4 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:14.323764 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-ff6abfe6-79ae-4b15-87cf-aa9378c712e4 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:14.329654 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ff6abfe6-79ae-4b15-87cf-aa9378c712e4 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:14.330136 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ff6abfe6-79ae-4b15-87cf-aa9378c712e4 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:14.330571 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ff6abfe6-79ae-4b15-87cf-aa9378c712e4 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:14.331288 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ff6abfe6-79ae-4b15-87cf-aa9378c712e4 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:14.331744 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ff6abfe6-79ae-4b15-87cf-aa9378c712e4 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:14.332169 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ff6abfe6-79ae-4b15-87cf-aa9378c712e4 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:14.459816 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-ff6abfe6-79ae-4b15-87cf-aa9378c712e4 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:14.466750 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-ff6abfe6-79ae-4b15-87cf-aa9378c712e4 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1674 microversion: 2.1 time: 0.147506 Oct 17 03:58:14.467346 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 340/679] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:58:14 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1674 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:58:15.490451 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-0e62828f-5731-4d22-8267-c0aab98a2268 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:15.491142 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-0e62828f-5731-4d22-8267-c0aab98a2268 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:15.497491 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0e62828f-5731-4d22-8267-c0aab98a2268 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:15.497994 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0e62828f-5731-4d22-8267-c0aab98a2268 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:15.498426 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0e62828f-5731-4d22-8267-c0aab98a2268 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:15.500259 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0e62828f-5731-4d22-8267-c0aab98a2268 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:15.500259 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0e62828f-5731-4d22-8267-c0aab98a2268 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:15.500259 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0e62828f-5731-4d22-8267-c0aab98a2268 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:15.630566 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-0e62828f-5731-4d22-8267-c0aab98a2268 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:15.638750 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-0e62828f-5731-4d22-8267-c0aab98a2268 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1674 microversion: 2.1 time: 0.152599 Oct 17 03:58:15.639340 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 340/680] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:58:15 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:58:16.661904 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-f83e8ea4-07b9-4ebe-a8e8-cfac401104ef tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:16.662519 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-f83e8ea4-07b9-4ebe-a8e8-cfac401104ef tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:16.668658 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f83e8ea4-07b9-4ebe-a8e8-cfac401104ef tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:16.669142 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f83e8ea4-07b9-4ebe-a8e8-cfac401104ef tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:16.669577 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f83e8ea4-07b9-4ebe-a8e8-cfac401104ef tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:16.670270 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f83e8ea4-07b9-4ebe-a8e8-cfac401104ef tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:16.670722 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f83e8ea4-07b9-4ebe-a8e8-cfac401104ef tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:16.671149 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f83e8ea4-07b9-4ebe-a8e8-cfac401104ef tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:16.802420 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-f83e8ea4-07b9-4ebe-a8e8-cfac401104ef tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:16.810563 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-f83e8ea4-07b9-4ebe-a8e8-cfac401104ef tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1674 microversion: 2.1 time: 0.152555 Oct 17 03:58:16.811122 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 341/681] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:58:16 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:58:17.834355 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-6f8238fb-4fe1-47bc-a7f5-1f9cded77d23 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:17.835233 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-6f8238fb-4fe1-47bc-a7f5-1f9cded77d23 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:17.842476 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-6f8238fb-4fe1-47bc-a7f5-1f9cded77d23 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:17.843043 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-6f8238fb-4fe1-47bc-a7f5-1f9cded77d23 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:17.843502 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-6f8238fb-4fe1-47bc-a7f5-1f9cded77d23 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:17.844200 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-6f8238fb-4fe1-47bc-a7f5-1f9cded77d23 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:17.844650 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-6f8238fb-4fe1-47bc-a7f5-1f9cded77d23 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:17.845068 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-6f8238fb-4fe1-47bc-a7f5-1f9cded77d23 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:18.058436 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-6f8238fb-4fe1-47bc-a7f5-1f9cded77d23 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:18.066068 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-6f8238fb-4fe1-47bc-a7f5-1f9cded77d23 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1674 microversion: 2.1 time: 0.235846 Oct 17 03:58:18.066652 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 341/682] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:58:17 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1674 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:58:18.512027 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [req-4e17193b-6a02-43d4-acd7-b3e2f1700d20 req-69091a5a-5d96-4a7c-8f30-2a434363ef83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf50abcd-84fd-4541-b899-b6f5dad606fe", "name": "network-vif-deleted", "tag": "8be4dcfc-e0ee-4198-b87d-22c3d9c49993"}]} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:58:18.522414 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-4e17193b-6a02-43d4-acd7-b3e2f1700d20 req-69091a5a-5d96-4a7c-8f30-2a434363ef83 service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:18.522891 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-4e17193b-6a02-43d4-acd7-b3e2f1700d20 req-69091a5a-5d96-4a7c-8f30-2a434363ef83 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:18.523345 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-4e17193b-6a02-43d4-acd7-b3e2f1700d20 req-69091a5a-5d96-4a7c-8f30-2a434363ef83 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:18.534592 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.compute.server_external_events [req-4e17193b-6a02-43d4-acd7-b3e2f1700d20 req-69091a5a-5d96-4a7c-8f30-2a434363ef83 service nova] Creating event network-vif-deleted:8be4dcfc-e0ee-4198-b87d-22c3d9c49993 for instance bf50abcd-84fd-4541-b899-b6f5dad606fe on hv-cinder-81558 Oct 17 03:58:18.539713 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [req-4e17193b-6a02-43d4-acd7-b3e2f1700d20 req-69091a5a-5d96-4a7c-8f30-2a434363ef83 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031609 Oct 17 03:58:18.540317 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 342/683] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 03:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:58:19.092412 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-9c3142f8-2e48-4671-9594-9fcf8b1f21a6 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:19.093403 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-9c3142f8-2e48-4671-9594-9fcf8b1f21a6 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:19.100359 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-9c3142f8-2e48-4671-9594-9fcf8b1f21a6 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:19.100858 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-9c3142f8-2e48-4671-9594-9fcf8b1f21a6 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:19.101289 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-9c3142f8-2e48-4671-9594-9fcf8b1f21a6 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:19.102267 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-9c3142f8-2e48-4671-9594-9fcf8b1f21a6 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:19.102932 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-9c3142f8-2e48-4671-9594-9fcf8b1f21a6 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:19.103419 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-9c3142f8-2e48-4671-9594-9fcf8b1f21a6 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:19.139767 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-9c3142f8-2e48-4671-9594-9fcf8b1f21a6 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:19.140571 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-9c3142f8-2e48-4671-9594-9fcf8b1f21a6 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:19.141161 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-9c3142f8-2e48-4671-9594-9fcf8b1f21a6 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:19.141880 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.objects.instance [None req-9c3142f8-2e48-4671-9594-9fcf8b1f21a6 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lazy-loading 'fault' on Instance uuid bf50abcd-84fd-4541-b899-b6f5dad606fe {{(pid=125871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:58:19.194512 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-9c3142f8-2e48-4671-9594-9fcf8b1f21a6 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:19.205137 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-9c3142f8-2e48-4671-9594-9fcf8b1f21a6 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1326 microversion: 2.1 time: 0.118794 Oct 17 03:58:19.210150 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 342/684] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:58:19 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1326 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:58:19.337630 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [req-45bc429b-190b-4264-a3a8-99793fd6a14a req-f1b8c02e-4d84-40ba-8686-c08080665455 admin admin] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:19.341567 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-45bc429b-190b-4264-a3a8-99793fd6a14a req-f1b8c02e-4d84-40ba-8686-c08080665455 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:19.342072 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-45bc429b-190b-4264-a3a8-99793fd6a14a req-f1b8c02e-4d84-40ba-8686-c08080665455 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:19.342494 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-45bc429b-190b-4264-a3a8-99793fd6a14a req-f1b8c02e-4d84-40ba-8686-c08080665455 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:19.350607 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-45bc429b-190b-4264-a3a8-99793fd6a14a req-f1b8c02e-4d84-40ba-8686-c08080665455 admin admin] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:19.351073 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-45bc429b-190b-4264-a3a8-99793fd6a14a req-f1b8c02e-4d84-40ba-8686-c08080665455 admin admin] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:19.351517 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-45bc429b-190b-4264-a3a8-99793fd6a14a req-f1b8c02e-4d84-40ba-8686-c08080665455 admin admin] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:19.364939 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [req-45bc429b-190b-4264-a3a8-99793fd6a14a req-f1b8c02e-4d84-40ba-8686-c08080665455 admin admin] 10.222.0.43 "DELETE /compute/v2.1/os-assisted-volume-snapshots/8e2dae48-28f7-4e0a-a200-a9856a2afce7?delete_info=%7B%22file_to_merge%22:%20%22volume-cf335981-369b-41f9-bc5d-32f51c47da12.8e2dae48-28f7-4e0a-a200-a9856a2afce7.vhdx%22,%20%22volume_id%22:%20%22cf335981-369b-41f9-bc5d-32f51c47da12%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.080018 Oct 17 03:58:19.365686 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 343/685] 10.222.0.43 () {62 vars in 1800 bytes} [Mon Oct 17 03:58:19 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/8e2dae48-28f7-4e0a-a200-a9856a2afce7?delete_info=%7B%22file_to_merge%22:%20%22volume-cf335981-369b-41f9-bc5d-32f51c47da12.8e2dae48-28f7-4e0a-a200-a9856a2afce7.vhdx%22,%20%22volume_id%22:%20%22cf335981-369b-41f9-bc5d-32f51c47da12%22%7D => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 03:58:20.232377 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-24d5905b-2a7c-468c-a0b9-e168ad27618f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:20.232987 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-24d5905b-2a7c-468c-a0b9-e168ad27618f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:20.239571 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-24d5905b-2a7c-468c-a0b9-e168ad27618f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:20.240064 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-24d5905b-2a7c-468c-a0b9-e168ad27618f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:20.240505 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-24d5905b-2a7c-468c-a0b9-e168ad27618f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:20.241203 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-24d5905b-2a7c-468c-a0b9-e168ad27618f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:20.241659 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-24d5905b-2a7c-468c-a0b9-e168ad27618f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:20.242218 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-24d5905b-2a7c-468c-a0b9-e168ad27618f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:20.273202 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-24d5905b-2a7c-468c-a0b9-e168ad27618f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:20.273678 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-24d5905b-2a7c-468c-a0b9-e168ad27618f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:20.274108 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-24d5905b-2a7c-468c-a0b9-e168ad27618f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:20.274543 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.objects.instance [None req-24d5905b-2a7c-468c-a0b9-e168ad27618f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lazy-loading 'fault' on Instance uuid bf50abcd-84fd-4541-b899-b6f5dad606fe {{(pid=125871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:58:20.314331 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-24d5905b-2a7c-468c-a0b9-e168ad27618f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:20.321764 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-24d5905b-2a7c-468c-a0b9-e168ad27618f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 200 len: 1326 microversion: 2.1 time: 0.093916 Oct 17 03:58:20.322322 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 343/686] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:58:20 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 1326 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:58:21.344750 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-578c65e3-c16d-49a8-8f32-57db7e068d66 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:21.345462 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-578c65e3-c16d-49a8-8f32-57db7e068d66 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:21.351652 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-578c65e3-c16d-49a8-8f32-57db7e068d66 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:21.357284 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-578c65e3-c16d-49a8-8f32-57db7e068d66 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:21.357284 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-578c65e3-c16d-49a8-8f32-57db7e068d66 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:21.357284 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-578c65e3-c16d-49a8-8f32-57db7e068d66 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:21.357284 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-578c65e3-c16d-49a8-8f32-57db7e068d66 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:21.357675 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-578c65e3-c16d-49a8-8f32-57db7e068d66 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:21.367643 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.wsgi [None req-578c65e3-c16d-49a8-8f32-57db7e068d66 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] HTTP exception thrown: Instance bf50abcd-84fd-4541-b899-b6f5dad606fe could not be found. Oct 17 03:58:21.369281 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-578c65e3-c16d-49a8-8f32-57db7e068d66 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Request method failure captured: Oct 17 03:58:21.369281 dv-cinder-815582-16-smb devstack@n-api.service[125872]: request: GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe HTTP/1.1 Oct 17 03:58:21.369281 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Accept: application/json Oct 17 03:58:21.369281 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Accept-Encoding: identity Oct 17 03:58:21.369281 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Connection: close Oct 17 03:58:21.369281 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Content-Length: 0 Oct 17 03:58:21.369281 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Content-Type: application/json Oct 17 03:58:21.369281 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Host: 10.222.0.16 Oct 17 03:58:21.369281 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Openstack-System-Scope: None Oct 17 03:58:21.369281 dv-cinder-815582-16-smb devstack@n-api.service[125872]: User-Agent: python-urllib3/1.26.12 Oct 17 03:58:21.369281 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Auth-Token: gAAAAABjTNHUiswWUhnjrR0hhoZeBffyByNZMrVmxd7bbTltcs3y2d4X7FFBbz_yIGdLFeb518UuzyqRupxLW69Zh6ny5zjddLi-PO8dd82WRy9WZpOqXU2BWS_D84rv_GQlxceW_SISy7XTfa1d-UELv8BREYBmaUTtIB8UTdn2Ve5EuQx5RCA Oct 17 03:58:21.369281 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Domain-Id: None Oct 17 03:58:21.369281 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Domain-Name: None Oct 17 03:58:21.369281 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Identity-Status: Confirmed Oct 17 03:58:21.369281 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Is-Admin-Project: True Oct 17 03:58:21.369281 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Domain-Id: default Oct 17 03:58:21.369281 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Domain-Name: Default Oct 17 03:58:21.369281 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Id: 4dcae38b1a3c47f2a80ae967d9298356 Oct 17 03:58:21.369281 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Name: tempest-AttachVolumeTestJSON-721155800 Oct 17 03:58:21.369281 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Role: reader,member Oct 17 03:58:21.369281 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Roles: reader,member Oct 17 03:58:21.371502 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4dcae38b1a3c47f2a80ae967d9298356"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4dcae38b1a3c47f2a80ae967d9298356"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4dcae38b1a3c47f2a80ae967d9298356"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4dcae38b1a3c47f2a80ae967d9298356", "adminURL": "http://10.222.0.16:8080"}]}] Oct 17 03:58:21.371502 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant: tempest-AttachVolumeTestJSON-721155800 Oct 17 03:58:21.371502 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant-Id: 4dcae38b1a3c47f2a80ae967d9298356 Oct 17 03:58:21.371502 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant-Name: tempest-AttachVolumeTestJSON-721155800 Oct 17 03:58:21.371502 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User: tempest-AttachVolumeTestJSON-721155800-project Oct 17 03:58:21.371502 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Domain-Id: default Oct 17 03:58:21.371502 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Domain-Name: Default Oct 17 03:58:21.371502 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Id: 6faa4e226ad74685a5de6988b616b070 Oct 17 03:58:21.371502 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Name: tempest-AttachVolumeTestJSON-721155800-project Oct 17 03:58:21.371502 dv-cinder-815582-16-smb devstack@n-api.service[125872]: method: > Oct 17 03:58:21.371502 dv-cinder-815582-16-smb devstack@n-api.service[125872]: exception: Instance bf50abcd-84fd-4541-b899-b6f5dad606fe could not be found. Oct 17 03:58:21.371502 dv-cinder-815582-16-smb devstack@n-api.service[125872]: action_args: {'id': 'bf50abcd-84fd-4541-b899-b6f5dad606fe'} Oct 17 03:58:21.372449 dv-cinder-815582-16-smb devstack@n-api.service[125872]: {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:58:21.372449 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:58:21.372449 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 03:58:21.372449 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 03:58:21.372449 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 03:58:21.372449 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 03:58:21.372449 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 03:58:21.372449 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 03:58:21.372449 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 03:58:21.372449 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 03:58:21.372449 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf50abcd-84fd-4541-b899-b6f5dad606fe could not be found. Oct 17 03:58:21.372449 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:58:21.372449 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:58:21.372449 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:58:21.372449 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:58:21.372449 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:58:21.372449 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:58:21.372449 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:58:21.372449 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:58:21.372449 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:58:21.373964 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:58:21.373964 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 03:58:21.373964 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 03:58:21.373964 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 03:58:21.373964 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 03:58:21.373964 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 03:58:21.373964 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:58:21.373964 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf50abcd-84fd-4541-b899-b6f5dad606fe could not be found. Oct 17 03:58:21.373964 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:58:21.373964 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:58:21.373964 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:58:21.373964 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:58:21.373964 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:58:21.373964 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:58:21.373964 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:58:21.373964 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:58:21.373964 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf50abcd-84fd-4541-b899-b6f5dad606fe could not be found. Oct 17 03:58:21.373964 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:58:21.380479 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-578c65e3-c16d-49a8-8f32-57db7e068d66 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Returning 404 to user: Instance bf50abcd-84fd-4541-b899-b6f5dad606fe could not be found. {{(pid=125872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:58:21.380479 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-578c65e3-c16d-49a8-8f32-57db7e068d66 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 404 len: 111 microversion: 2.1 time: 0.031568 Oct 17 03:58:21.380479 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 344/687] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:58:21 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 03:58:21.381185 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-7753ff6b-2c7f-4040-81ea-a3abc0f3c49f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '.version_select at 0x7fd72a61e940>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:21.455750 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-7753ff6b-2c7f-4040-81ea-a3abc0f3c49f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-120723541" status: 202 len: 0 microversion: 2.1 time: 0.079195 Oct 17 03:58:21.456375 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 344/688] 10.222.0.16 () {58 vars in 1218 bytes} [Mon Oct 17 03:58:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-120723541 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 03:58:22.233344 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-2723120d-a036-4534-8ebe-5b0694385f8d tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Action: 'create', calling method: .version_select at 0x7fd72a640dc0>, body: {"keypair": {"name": "tempest-keypair-1909019679", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBErz69mcN+b97Ls2MI8njhraTE1YZQ9HXHeW8D9RMwY3cOGqXjmIVXK7z9FICj4sM7lohVicPNDN7aUV08OPhW9bYPkwvSupJu8AvqWLxZcw4/u0ohKc50Q80YUxXfUULg=="}} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:58:22.248493 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.quota [None req-2723120d-a036-4534-8ebe-5b0694385f8d tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Getting quotas for project 4dcae38b1a3c47f2a80ae967d9298356. Resources: {'key_pairs'} {{(pid=125872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 03:58:22.252367 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.quota [None req-2723120d-a036-4534-8ebe-5b0694385f8d tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Getting quotas for user 6faa4e226ad74685a5de6988b616b070 and project 4dcae38b1a3c47f2a80ae967d9298356. Resources: {'key_pairs'} {{(pid=125872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 03:58:22.328327 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-2723120d-a036-4534-8ebe-5b0694385f8d tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.098933 Oct 17 03:58:22.328924 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 345/689] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 17 03:58:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:58:23.532361 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_cell0:SELECT=2 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:58:23.583223 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [req-62d20da2-0b13-4fa8-98b5-bae5915d69cb req-06608418-4ba1-4546-94bb-4e7456271a21 admin admin] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:23.586025 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-62d20da2-0b13-4fa8-98b5-bae5915d69cb req-06608418-4ba1-4546-94bb-4e7456271a21 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:23.586514 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-62d20da2-0b13-4fa8-98b5-bae5915d69cb req-06608418-4ba1-4546-94bb-4e7456271a21 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:23.586947 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-62d20da2-0b13-4fa8-98b5-bae5915d69cb req-06608418-4ba1-4546-94bb-4e7456271a21 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:23.596653 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-62d20da2-0b13-4fa8-98b5-bae5915d69cb req-06608418-4ba1-4546-94bb-4e7456271a21 admin admin] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:23.597129 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-62d20da2-0b13-4fa8-98b5-bae5915d69cb req-06608418-4ba1-4546-94bb-4e7456271a21 admin admin] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:23.597565 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-62d20da2-0b13-4fa8-98b5-bae5915d69cb req-06608418-4ba1-4546-94bb-4e7456271a21 admin admin] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:23.611651 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [req-62d20da2-0b13-4fa8-98b5-bae5915d69cb req-06608418-4ba1-4546-94bb-4e7456271a21 admin admin] 10.222.0.43 "DELETE /compute/v2.1/os-assisted-volume-snapshots/5f08582c-955b-4d85-a042-91804fa68279?delete_info=%7B%22file_to_merge%22:%20%22volume-cf335981-369b-41f9-bc5d-32f51c47da12.5f08582c-955b-4d85-a042-91804fa68279.vhdx%22,%20%22volume_id%22:%20%22cf335981-369b-41f9-bc5d-32f51c47da12%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.080490 Oct 17 03:58:23.612301 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 345/690] 10.222.0.43 () {62 vars in 1800 bytes} [Mon Oct 17 03:58:23 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/5f08582c-955b-4d85-a042-91804fa68279?delete_info=%7B%22file_to_merge%22:%20%22volume-cf335981-369b-41f9-bc5d-32f51c47da12.5f08582c-955b-4d85-a042-91804fa68279.vhdx%22,%20%22volume_id%22:%20%22cf335981-369b-41f9-bc5d-32f51c47da12%22%7D => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 03:58:24.483192 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-96f410b3-95ba-4426-a179-da2fd7fd8fcc tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1105882390", "imageRef": "add1979e-0a3b-4403-a8ae-8d9a7b045fc2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6869a997-10fb-4abf-b4fa-a753fa0e6e23"}], "security_groups": [{"name": "tempest-securitygroup--839459188"}], "key_name": "tempest-keypair-1909019679", "user_data": "}} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:58:24.585890 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.network.neutron [None req-96f410b3-95ba-4426-a179-da2fd7fd8fcc tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] validate_networks() for [('6869a997-10fb-4abf-b4fa-a753fa0e6e23', None, None, None, None, None)] {{(pid=125872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 03:58:24.954508 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.virt.hardware [None req-96f410b3-95ba-4426-a179-da2fd7fd8fcc tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Flavor limits 0:0:0 {{(pid=125872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 03:58:24.954954 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.virt.hardware [None req-96f410b3-95ba-4426-a179-da2fd7fd8fcc tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Image limits 0:0:0 {{(pid=125872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 03:58:24.955465 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.virt.hardware [None req-96f410b3-95ba-4426-a179-da2fd7fd8fcc tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Flavor pref 0:0:0 {{(pid=125872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 03:58:24.955875 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.virt.hardware [None req-96f410b3-95ba-4426-a179-da2fd7fd8fcc tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Image pref 0:0:0 {{(pid=125872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 03:58:24.956316 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.virt.hardware [None req-96f410b3-95ba-4426-a179-da2fd7fd8fcc tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 03:58:24.965026 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-96f410b3-95ba-4426-a179-da2fd7fd8fcc tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:24.965503 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-96f410b3-95ba-4426-a179-da2fd7fd8fcc tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:24.965931 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-96f410b3-95ba-4426-a179-da2fd7fd8fcc tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:24.966650 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-96f410b3-95ba-4426-a179-da2fd7fd8fcc tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:24.967097 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-96f410b3-95ba-4426-a179-da2fd7fd8fcc tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:24.967545 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-96f410b3-95ba-4426-a179-da2fd7fd8fcc tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:24.984539 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.quota [None req-96f410b3-95ba-4426-a179-da2fd7fd8fcc tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Getting quotas for project 4dcae38b1a3c47f2a80ae967d9298356. Resources: {'cores', 'instances', 'ram'} {{(pid=125872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 03:58:24.988390 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.quota [None req-96f410b3-95ba-4426-a179-da2fd7fd8fcc tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Getting quotas for user 6faa4e226ad74685a5de6988b616b070 and project 4dcae38b1a3c47f2a80ae967d9298356. Resources: {'cores', 'instances', 'ram'} {{(pid=125872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 03:58:24.999512 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-96f410b3-95ba-4426-a179-da2fd7fd8fcc tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Going to run 1 instances... {{(pid=125872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 03:58:25.001758 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-96f410b3-95ba-4426-a179-da2fd7fd8fcc tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: 53df9edf-f0ce-44bd-82fb-378d51d91e67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='add1979e-0a3b-4403-a8ae-8d9a7b045fc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 03:58:25.131856 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-96f410b3-95ba-4426-a179-da2fd7fd8fcc tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.653402 Oct 17 03:58:25.132615 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 346/691] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 17 03:58:24 2022] POST /compute/v2.1/servers => generated 401 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 03:58:25.144901 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-df3622a0-3c7f-48c8-b3b0-eea2f60c6c36 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:25.145601 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-df3622a0-3c7f-48c8-b3b0-eea2f60c6c36 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: 53df9edf-f0ce-44bd-82fb-378d51d91e67] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:25.202093 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-df3622a0-3c7f-48c8-b3b0-eea2f60c6c36 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:25.208862 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-df3622a0-3c7f-48c8-b3b0-eea2f60c6c36 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67" status: 200 len: 1238 microversion: 2.1 time: 0.068170 Oct 17 03:58:25.209434 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 346/692] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:58:25 2022] GET /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67 => generated 1238 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:58:26.231575 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-459d9f60-4d77-47af-85d2-b7b5677fbf6f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:26.232181 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-459d9f60-4d77-47af-85d2-b7b5677fbf6f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: 53df9edf-f0ce-44bd-82fb-378d51d91e67] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:26.238125 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-459d9f60-4d77-47af-85d2-b7b5677fbf6f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:26.238602 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-459d9f60-4d77-47af-85d2-b7b5677fbf6f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:26.239030 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-459d9f60-4d77-47af-85d2-b7b5677fbf6f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:26.239742 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-459d9f60-4d77-47af-85d2-b7b5677fbf6f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:26.240192 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-459d9f60-4d77-47af-85d2-b7b5677fbf6f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:26.240608 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-459d9f60-4d77-47af-85d2-b7b5677fbf6f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:26.301257 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-459d9f60-4d77-47af-85d2-b7b5677fbf6f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:26.309369 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-459d9f60-4d77-47af-85d2-b7b5677fbf6f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67" status: 200 len: 1242 microversion: 2.1 time: 0.082276 Oct 17 03:58:26.309925 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 347/693] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:58:26 2022] GET /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67 => generated 1242 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:58:27.332006 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-a723eae6-e0b2-4c16-aabb-aeebd89b6f86 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:27.332616 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-a723eae6-e0b2-4c16-aabb-aeebd89b6f86 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: 53df9edf-f0ce-44bd-82fb-378d51d91e67] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:27.340457 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a723eae6-e0b2-4c16-aabb-aeebd89b6f86 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:27.340907 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a723eae6-e0b2-4c16-aabb-aeebd89b6f86 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:27.341341 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a723eae6-e0b2-4c16-aabb-aeebd89b6f86 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:27.342030 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a723eae6-e0b2-4c16-aabb-aeebd89b6f86 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:27.342480 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a723eae6-e0b2-4c16-aabb-aeebd89b6f86 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:27.342900 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a723eae6-e0b2-4c16-aabb-aeebd89b6f86 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:27.406539 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-a723eae6-e0b2-4c16-aabb-aeebd89b6f86 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:27.414425 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-a723eae6-e0b2-4c16-aabb-aeebd89b6f86 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67" status: 200 len: 1242 microversion: 2.1 time: 0.086313 Oct 17 03:58:27.414988 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 347/694] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:58:27 2022] GET /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67 => generated 1242 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:58:28.436584 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-ff26b618-dfad-4b8d-9479-7d97d42adfa7 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:28.437137 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-ff26b618-dfad-4b8d-9479-7d97d42adfa7 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: 53df9edf-f0ce-44bd-82fb-378d51d91e67] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:28.444267 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ff26b618-dfad-4b8d-9479-7d97d42adfa7 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:28.444750 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ff26b618-dfad-4b8d-9479-7d97d42adfa7 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:28.445183 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ff26b618-dfad-4b8d-9479-7d97d42adfa7 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:28.445872 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ff26b618-dfad-4b8d-9479-7d97d42adfa7 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:28.446318 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ff26b618-dfad-4b8d-9479-7d97d42adfa7 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:28.446739 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ff26b618-dfad-4b8d-9479-7d97d42adfa7 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:28.506514 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-ff26b618-dfad-4b8d-9479-7d97d42adfa7 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:28.514367 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-ff26b618-dfad-4b8d-9479-7d97d42adfa7 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67" status: 200 len: 1290 microversion: 2.1 time: 0.081803 Oct 17 03:58:28.514923 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 348/695] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:58:28 2022] GET /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67 => generated 1290 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:58:28.921541 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [req-dcb762b5-21fd-4746-88b3-5468c4f5778d req-e4c4fdfa-7cf3-4411-9de8-0e4add298b3d admin admin] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:28.925731 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-dcb762b5-21fd-4746-88b3-5468c4f5778d req-e4c4fdfa-7cf3-4411-9de8-0e4add298b3d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:28.935829 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-dcb762b5-21fd-4746-88b3-5468c4f5778d req-e4c4fdfa-7cf3-4411-9de8-0e4add298b3d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:28.936263 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-dcb762b5-21fd-4746-88b3-5468c4f5778d req-e4c4fdfa-7cf3-4411-9de8-0e4add298b3d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:28.953810 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-dcb762b5-21fd-4746-88b3-5468c4f5778d req-e4c4fdfa-7cf3-4411-9de8-0e4add298b3d admin admin] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:28.954296 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-dcb762b5-21fd-4746-88b3-5468c4f5778d req-e4c4fdfa-7cf3-4411-9de8-0e4add298b3d admin admin] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:28.954732 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-dcb762b5-21fd-4746-88b3-5468c4f5778d req-e4c4fdfa-7cf3-4411-9de8-0e4add298b3d admin admin] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:28.970115 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [req-dcb762b5-21fd-4746-88b3-5468c4f5778d req-e4c4fdfa-7cf3-4411-9de8-0e4add298b3d admin admin] 10.222.0.43 "DELETE /compute/v2.1/os-assisted-volume-snapshots/f976132c-0238-4e5f-ab0e-9cd01b292201?delete_info=%7B%22file_to_merge%22:%20%22volume-cf335981-369b-41f9-bc5d-32f51c47da12.f976132c-0238-4e5f-ab0e-9cd01b292201.vhdx%22,%20%22volume_id%22:%20%22cf335981-369b-41f9-bc5d-32f51c47da12%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.102532 Oct 17 03:58:28.970639 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 348/696] 10.222.0.43 () {62 vars in 1800 bytes} [Mon Oct 17 03:58:28 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/f976132c-0238-4e5f-ab0e-9cd01b292201?delete_info=%7B%22file_to_merge%22:%20%22volume-cf335981-369b-41f9-bc5d-32f51c47da12.f976132c-0238-4e5f-ab0e-9cd01b292201.vhdx%22,%20%22volume_id%22:%20%22cf335981-369b-41f9-bc5d-32f51c47da12%22%7D => generated 0 bytes in 104 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 03:58:29.541454 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-47012866-f528-4e64-ab4b-10b936520ed7 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:29.542076 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-47012866-f528-4e64-ab4b-10b936520ed7 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: 53df9edf-f0ce-44bd-82fb-378d51d91e67] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:29.548524 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-47012866-f528-4e64-ab4b-10b936520ed7 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:29.549008 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-47012866-f528-4e64-ab4b-10b936520ed7 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:29.549445 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-47012866-f528-4e64-ab4b-10b936520ed7 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:29.550196 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-47012866-f528-4e64-ab4b-10b936520ed7 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:29.550653 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-47012866-f528-4e64-ab4b-10b936520ed7 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:29.551075 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-47012866-f528-4e64-ab4b-10b936520ed7 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:29.611673 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-47012866-f528-4e64-ab4b-10b936520ed7 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:29.619454 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-47012866-f528-4e64-ab4b-10b936520ed7 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67" status: 200 len: 1296 microversion: 2.1 time: 0.081940 Oct 17 03:58:29.620031 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 349/697] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:58:29 2022] GET /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67 => generated 1296 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:58:30.645070 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-39e850f1-993e-4644-a425-17aab456009a tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:30.645781 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-39e850f1-993e-4644-a425-17aab456009a tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: 53df9edf-f0ce-44bd-82fb-378d51d91e67] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:30.651851 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-39e850f1-993e-4644-a425-17aab456009a tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:30.652904 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-39e850f1-993e-4644-a425-17aab456009a tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:30.653344 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-39e850f1-993e-4644-a425-17aab456009a tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:30.654049 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-39e850f1-993e-4644-a425-17aab456009a tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:30.654508 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-39e850f1-993e-4644-a425-17aab456009a tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:30.654957 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-39e850f1-993e-4644-a425-17aab456009a tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:30.848048 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-39e850f1-993e-4644-a425-17aab456009a tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:30.856440 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-39e850f1-993e-4644-a425-17aab456009a tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67" status: 200 len: 1363 microversion: 2.1 time: 0.217251 Oct 17 03:58:30.857122 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 349/698] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:58:30 2022] GET /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67 => generated 1363 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:58:30.999014 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [req-26c20c5e-752f-4964-ac11-285e5dbf30c9 req-2d895ae2-d23e-4a7e-8a57-52868e39561b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53df9edf-f0ce-44bd-82fb-378d51d91e67", "tag": "434914fe-0f7a-41ed-883f-4183e0fdc295"}]} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:58:31.008867 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-26c20c5e-752f-4964-ac11-285e5dbf30c9 req-2d895ae2-d23e-4a7e-8a57-52868e39561b service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:31.009347 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-26c20c5e-752f-4964-ac11-285e5dbf30c9 req-2d895ae2-d23e-4a7e-8a57-52868e39561b service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:31.009774 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-26c20c5e-752f-4964-ac11-285e5dbf30c9 req-2d895ae2-d23e-4a7e-8a57-52868e39561b service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:31.021689 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.compute.server_external_events [req-26c20c5e-752f-4964-ac11-285e5dbf30c9 req-2d895ae2-d23e-4a7e-8a57-52868e39561b service nova] Creating event network-changed:434914fe-0f7a-41ed-883f-4183e0fdc295 for instance 53df9edf-f0ce-44bd-82fb-378d51d91e67 on hv-cinder-81558 Oct 17 03:58:31.026696 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [req-26c20c5e-752f-4964-ac11-285e5dbf30c9 req-2d895ae2-d23e-4a7e-8a57-52868e39561b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031862 Oct 17 03:58:31.027652 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 350/699] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 03:58:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:58:31.880307 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-efac0e6f-48d3-41a8-96a3-822400fe5dec tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:31.880841 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-efac0e6f-48d3-41a8-96a3-822400fe5dec tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: 53df9edf-f0ce-44bd-82fb-378d51d91e67] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:31.888191 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-efac0e6f-48d3-41a8-96a3-822400fe5dec tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:31.888674 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-efac0e6f-48d3-41a8-96a3-822400fe5dec tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:31.889103 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-efac0e6f-48d3-41a8-96a3-822400fe5dec tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:31.890020 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-efac0e6f-48d3-41a8-96a3-822400fe5dec tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:31.890222 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-efac0e6f-48d3-41a8-96a3-822400fe5dec tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:31.890639 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-efac0e6f-48d3-41a8-96a3-822400fe5dec tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:31.912924 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-6299302b-59be-48e6-9792-c57898370331 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:31.913515 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-6299302b-59be-48e6-9792-c57898370331 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] [instance: 7c191ac7-443c-460d-88b3-5d49f5f733c7] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:31.919586 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6299302b-59be-48e6-9792-c57898370331 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:31.920073 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6299302b-59be-48e6-9792-c57898370331 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:31.920515 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6299302b-59be-48e6-9792-c57898370331 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:31.921205 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6299302b-59be-48e6-9792-c57898370331 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:31.921664 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6299302b-59be-48e6-9792-c57898370331 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:31.922089 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6299302b-59be-48e6-9792-c57898370331 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:32.001652 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.objects.instance [None req-6299302b-59be-48e6-9792-c57898370331 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lazy-loading 'services' on Instance uuid 7c191ac7-443c-460d-88b3-5d49f5f733c7 {{(pid=125872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:58:32.025481 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-efac0e6f-48d3-41a8-96a3-822400fe5dec tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:32.033988 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-efac0e6f-48d3-41a8-96a3-822400fe5dec tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67" status: 200 len: 1363 microversion: 2.1 time: 0.157580 Oct 17 03:58:32.034595 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 350/700] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:58:31 2022] GET /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:58:32.217075 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-6299302b-59be-48e6-9792-c57898370331 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7c191ac7-443c-460d-88b3-5d49f5f733c7/os-volume_attachments/cf335981-369b-41f9-bc5d-32f51c47da12" status: 202 len: 0 microversion: 2.1 time: 0.308172 Oct 17 03:58:32.217649 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 351/701] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Oct 17 03:58:31 2022] DELETE /compute/v2.1/servers/7c191ac7-443c-460d-88b3-5d49f5f733c7/os-volume_attachments/cf335981-369b-41f9-bc5d-32f51c47da12 => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 03:58:32.923194 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-8294d118-ac42-4635-9d0a-b45996806c0e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:32.923703 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-8294d118-ac42-4635-9d0a-b45996806c0e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:32.930047 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8294d118-ac42-4635-9d0a-b45996806c0e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:32.930526 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8294d118-ac42-4635-9d0a-b45996806c0e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:32.930958 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8294d118-ac42-4635-9d0a-b45996806c0e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:32.931676 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8294d118-ac42-4635-9d0a-b45996806c0e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:32.932130 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8294d118-ac42-4635-9d0a-b45996806c0e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:32.932548 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8294d118-ac42-4635-9d0a-b45996806c0e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:32.960759 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:58:32.965921 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-8294d118-ac42-4635-9d0a-b45996806c0e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf/os-volume_attachments/74c56665-48ac-4d43-a05f-2f42078b1134" status: 200 len: 194 microversion: 2.20 time: 0.046718 Oct 17 03:58:32.971278 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 351/702] 10.222.0.16 () {60 vars in 1454 bytes} [Mon Oct 17 03:58:32 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf/os-volume_attachments/74c56665-48ac-4d43-a05f-2f42078b1134 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 03:58:33.035048 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-39cb52dd-fc3f-4eb8-ad1a-705f95dded32 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:33.035668 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-39cb52dd-fc3f-4eb8-ad1a-705f95dded32 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:33.037561 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=4 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:58:33.042359 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-39cb52dd-fc3f-4eb8-ad1a-705f95dded32 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:33.042844 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-39cb52dd-fc3f-4eb8-ad1a-705f95dded32 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:33.043314 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-39cb52dd-fc3f-4eb8-ad1a-705f95dded32 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:33.046956 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-39cb52dd-fc3f-4eb8-ad1a-705f95dded32 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:33.046956 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-39cb52dd-fc3f-4eb8-ad1a-705f95dded32 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:33.046956 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-39cb52dd-fc3f-4eb8-ad1a-705f95dded32 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:33.057704 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-f63cab67-fbb5-4bfb-9629-8abfc7d4c9cc tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:33.058989 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-f63cab67-fbb5-4bfb-9629-8abfc7d4c9cc tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: 53df9edf-f0ce-44bd-82fb-378d51d91e67] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:33.065762 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f63cab67-fbb5-4bfb-9629-8abfc7d4c9cc tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:33.066252 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f63cab67-fbb5-4bfb-9629-8abfc7d4c9cc tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:33.066693 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f63cab67-fbb5-4bfb-9629-8abfc7d4c9cc tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:33.067420 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f63cab67-fbb5-4bfb-9629-8abfc7d4c9cc tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:33.067887 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f63cab67-fbb5-4bfb-9629-8abfc7d4c9cc tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:33.068564 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f63cab67-fbb5-4bfb-9629-8abfc7d4c9cc tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:33.125740 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.objects.instance [None req-39cb52dd-fc3f-4eb8-ad1a-705f95dded32 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lazy-loading 'services' on Instance uuid 0982f171-946d-4314-89f2-c139e6bf9adf {{(pid=125872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:58:33.201092 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-f63cab67-fbb5-4bfb-9629-8abfc7d4c9cc tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:33.208629 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-f63cab67-fbb5-4bfb-9629-8abfc7d4c9cc tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67" status: 200 len: 1363 microversion: 2.1 time: 0.154867 Oct 17 03:58:33.209188 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 352/703] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:58:33 2022] GET /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:58:33.317864 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-39cb52dd-fc3f-4eb8-ad1a-705f95dded32 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf/os-volume_attachments/74c56665-48ac-4d43-a05f-2f42078b1134" status: 202 len: 0 microversion: 2.20 time: 0.287232 Oct 17 03:58:33.318464 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 352/704] 10.222.0.16 () {60 vars in 1457 bytes} [Mon Oct 17 03:58:33 2022] DELETE /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf/os-volume_attachments/74c56665-48ac-4d43-a05f-2f42078b1134 => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 03:58:33.328677 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-c5935703-7dc4-4cff-8161-4440e82c7699 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:33.329643 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-c5935703-7dc4-4cff-8161-4440e82c7699 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:33.335977 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c5935703-7dc4-4cff-8161-4440e82c7699 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:33.336462 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c5935703-7dc4-4cff-8161-4440e82c7699 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:33.336895 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c5935703-7dc4-4cff-8161-4440e82c7699 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:33.337587 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c5935703-7dc4-4cff-8161-4440e82c7699 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:33.338042 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c5935703-7dc4-4cff-8161-4440e82c7699 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:33.338468 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c5935703-7dc4-4cff-8161-4440e82c7699 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:33.368820 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-c5935703-7dc4-4cff-8161-4440e82c7699 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045843 Oct 17 03:58:33.369396 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 353/705] 10.222.0.16 () {60 vars in 1343 bytes} [Mon Oct 17 03:58:33 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 03:58:34.230803 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-2f7d06cb-def9-46d1-a81e-9d24f69df03b tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:34.231528 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-2f7d06cb-def9-46d1-a81e-9d24f69df03b tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: 53df9edf-f0ce-44bd-82fb-378d51d91e67] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:34.237713 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2f7d06cb-def9-46d1-a81e-9d24f69df03b tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:34.238193 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2f7d06cb-def9-46d1-a81e-9d24f69df03b tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:34.238630 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2f7d06cb-def9-46d1-a81e-9d24f69df03b tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:34.239358 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2f7d06cb-def9-46d1-a81e-9d24f69df03b tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:34.239813 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2f7d06cb-def9-46d1-a81e-9d24f69df03b tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:34.240235 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2f7d06cb-def9-46d1-a81e-9d24f69df03b tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:34.244412 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_cell1:SELECT=75,nova_cell1:INSERT=2 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:58:34.373238 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-2f7d06cb-def9-46d1-a81e-9d24f69df03b tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:34.380909 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-2f7d06cb-def9-46d1-a81e-9d24f69df03b tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67" status: 200 len: 1363 microversion: 2.1 time: 0.154793 Oct 17 03:58:34.381468 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 353/706] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:58:34 2022] GET /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:58:34.382173 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-82354ea0-5a17-43bd-9358-7565daea3d1a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:34.384614 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-82354ea0-5a17-43bd-9358-7565daea3d1a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:34.391686 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-82354ea0-5a17-43bd-9358-7565daea3d1a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:34.404959 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-82354ea0-5a17-43bd-9358-7565daea3d1a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:34.404959 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-82354ea0-5a17-43bd-9358-7565daea3d1a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:34.404959 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-82354ea0-5a17-43bd-9358-7565daea3d1a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:34.404959 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-82354ea0-5a17-43bd-9358-7565daea3d1a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:34.405338 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-82354ea0-5a17-43bd-9358-7565daea3d1a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:34.411883 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-b78c6e49-ebda-48f2-b59e-5ebd6f05fd32 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:34.412158 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-b78c6e49-ebda-48f2-b59e-5ebd6f05fd32 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] [instance: 7c191ac7-443c-460d-88b3-5d49f5f733c7] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:34.418079 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b78c6e49-ebda-48f2-b59e-5ebd6f05fd32 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:34.418558 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b78c6e49-ebda-48f2-b59e-5ebd6f05fd32 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:34.418991 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b78c6e49-ebda-48f2-b59e-5ebd6f05fd32 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:34.420162 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b78c6e49-ebda-48f2-b59e-5ebd6f05fd32 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:34.420162 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b78c6e49-ebda-48f2-b59e-5ebd6f05fd32 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:34.420557 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b78c6e49-ebda-48f2-b59e-5ebd6f05fd32 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:34.423983 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-82354ea0-5a17-43bd-9358-7565daea3d1a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045841 Oct 17 03:58:34.425454 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 354/707] 10.222.0.16 () {60 vars in 1343 bytes} [Mon Oct 17 03:58:34 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:58:34.445503 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-b78c6e49-ebda-48f2-b59e-5ebd6f05fd32 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] [instance: 7c191ac7-443c-460d-88b3-5d49f5f733c7] Going to try to terminate instance {{(pid=125872) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 03:58:34.502091 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-294b6646-afc5-4bdc-a087-2db501de8602 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:34.502091 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-294b6646-afc5-4bdc-a087-2db501de8602 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:34.502091 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-294b6646-afc5-4bdc-a087-2db501de8602 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:34.502091 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-294b6646-afc5-4bdc-a087-2db501de8602 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:34.502627 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-294b6646-afc5-4bdc-a087-2db501de8602 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:34.502627 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-294b6646-afc5-4bdc-a087-2db501de8602 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:34.502627 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-294b6646-afc5-4bdc-a087-2db501de8602 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:34.502627 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-294b6646-afc5-4bdc-a087-2db501de8602 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:34.524183 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-294b6646-afc5-4bdc-a087-2db501de8602 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Going to try to terminate instance {{(pid=125871) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 03:58:34.738469 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-b78c6e49-ebda-48f2-b59e-5ebd6f05fd32 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7c191ac7-443c-460d-88b3-5d49f5f733c7" status: 204 len: 0 microversion: 2.1 time: 0.330570 Oct 17 03:58:34.739069 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 354/708] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 17 03:58:34 2022] DELETE /compute/v2.1/servers/7c191ac7-443c-460d-88b3-5d49f5f733c7 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 03:58:34.748308 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-6805ab54-31e3-4998-bca5-276a848d7cc1 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:34.749009 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-6805ab54-31e3-4998-bca5-276a848d7cc1 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] [instance: 7c191ac7-443c-460d-88b3-5d49f5f733c7] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:34.755086 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6805ab54-31e3-4998-bca5-276a848d7cc1 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:34.755537 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6805ab54-31e3-4998-bca5-276a848d7cc1 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:34.755968 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6805ab54-31e3-4998-bca5-276a848d7cc1 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:34.756678 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6805ab54-31e3-4998-bca5-276a848d7cc1 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:34.757246 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6805ab54-31e3-4998-bca5-276a848d7cc1 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:34.757666 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6805ab54-31e3-4998-bca5-276a848d7cc1 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:34.818176 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-294b6646-afc5-4bdc-a087-2db501de8602 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 204 len: 0 microversion: 2.20 time: 0.333070 Oct 17 03:58:34.818943 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 355/709] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Oct 17 03:58:34 2022] DELETE /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 17 03:58:34.828113 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-0f333af9-ea80-4053-8d0f-2e85446158a8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:34.828925 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-0f333af9-ea80-4053-8d0f-2e85446158a8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:34.835260 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0f333af9-ea80-4053-8d0f-2e85446158a8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:34.835787 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0f333af9-ea80-4053-8d0f-2e85446158a8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:34.836340 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0f333af9-ea80-4053-8d0f-2e85446158a8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:34.837167 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0f333af9-ea80-4053-8d0f-2e85446158a8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:34.837697 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0f333af9-ea80-4053-8d0f-2e85446158a8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:34.838131 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0f333af9-ea80-4053-8d0f-2e85446158a8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:34.886328 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-6805ab54-31e3-4998-bca5-276a848d7cc1 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ffc76632a456d9e833381783d4dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed59353a4741cbb901808f7d2210d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:34.895057 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-6805ab54-31e3-4998-bca5-276a848d7cc1 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] 10.222.0.16 "GET /compute/v2.1/servers/7c191ac7-443c-460d-88b3-5d49f5f733c7" status: 200 len: 1514 microversion: 2.1 time: 0.151484 Oct 17 03:58:34.895660 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 355/710] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:58:34 2022] GET /compute/v2.1/servers/7c191ac7-443c-460d-88b3-5d49f5f733c7 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:58:34.970397 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-0f333af9-ea80-4053-8d0f-2e85446158a8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:34.978394 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-0f333af9-ea80-4053-8d0f-2e85446158a8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:34.979854 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-0f333af9-ea80-4053-8d0f-2e85446158a8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:34.981554 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-0f333af9-ea80-4053-8d0f-2e85446158a8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1723 microversion: 2.20 time: 0.158426 Oct 17 03:58:34.982104 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 356/711] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:58:34 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:58:35.301079 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-b97e91ca-0af4-44a2-a47f-2055c9f60bde tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:35.301585 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-b97e91ca-0af4-44a2-a47f-2055c9f60bde tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 57546995-2ef9-4773-a47a-13cbd2a831a9] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:35.303609 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_cell0:SELECT=6 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:58:35.304354 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_cell0:SELECT=10 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:58:35.309674 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b97e91ca-0af4-44a2-a47f-2055c9f60bde tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:35.310258 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b97e91ca-0af4-44a2-a47f-2055c9f60bde tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:35.310704 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b97e91ca-0af4-44a2-a47f-2055c9f60bde tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:35.311446 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b97e91ca-0af4-44a2-a47f-2055c9f60bde tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:35.311907 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b97e91ca-0af4-44a2-a47f-2055c9f60bde tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:35.312333 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b97e91ca-0af4-44a2-a47f-2055c9f60bde tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:35.392333 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.objects.instance [None req-b97e91ca-0af4-44a2-a47f-2055c9f60bde tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lazy-loading 'services' on Instance uuid 57546995-2ef9-4773-a47a-13cbd2a831a9 {{(pid=125872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:58:35.405786 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-2d1d1b22-8a16-4dea-8ba9-dda7e344407a tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:35.406446 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-2d1d1b22-8a16-4dea-8ba9-dda7e344407a tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: 53df9edf-f0ce-44bd-82fb-378d51d91e67] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:35.408425 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_cell0:SELECT=2 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:58:35.416470 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2d1d1b22-8a16-4dea-8ba9-dda7e344407a tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:35.417055 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2d1d1b22-8a16-4dea-8ba9-dda7e344407a tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:35.417497 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2d1d1b22-8a16-4dea-8ba9-dda7e344407a tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:35.418760 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2d1d1b22-8a16-4dea-8ba9-dda7e344407a tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:35.419563 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2d1d1b22-8a16-4dea-8ba9-dda7e344407a tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:35.420005 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2d1d1b22-8a16-4dea-8ba9-dda7e344407a tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:35.553481 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-2d1d1b22-8a16-4dea-8ba9-dda7e344407a tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:35.561436 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-2d1d1b22-8a16-4dea-8ba9-dda7e344407a tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67" status: 200 len: 1363 microversion: 2.1 time: 0.160829 Oct 17 03:58:35.562013 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 357/712] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:58:35 2022] GET /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:58:35.617059 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-b97e91ca-0af4-44a2-a47f-2055c9f60bde tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "DELETE /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9/os-volume_attachments/b92cd2b1-85e3-409b-bef1-1d2a0932c463" status: 202 len: 0 microversion: 2.1 time: 0.319685 Oct 17 03:58:35.617753 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 356/713] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Oct 17 03:58:35 2022] DELETE /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9/os-volume_attachments/b92cd2b1-85e3-409b-bef1-1d2a0932c463 => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 03:58:35.626243 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-68fa5691-f675-42b4-b216-54c4b6e60807 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:35.628837 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-68fa5691-f675-42b4-b216-54c4b6e60807 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 57546995-2ef9-4773-a47a-13cbd2a831a9] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:35.634744 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-68fa5691-f675-42b4-b216-54c4b6e60807 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:35.635261 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-68fa5691-f675-42b4-b216-54c4b6e60807 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:35.635698 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-68fa5691-f675-42b4-b216-54c4b6e60807 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:35.636465 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-68fa5691-f675-42b4-b216-54c4b6e60807 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:35.637723 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-68fa5691-f675-42b4-b216-54c4b6e60807 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:35.638143 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-68fa5691-f675-42b4-b216-54c4b6e60807 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:35.660433 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [req-33355762-5095-493e-b4fb-fa2cc39ac0bf req-7c81ae9c-80c7-4ebb-91b6-83009381ec6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53df9edf-f0ce-44bd-82fb-378d51d91e67", "name": "network-vif-plugged", "status": "completed", "tag": "434914fe-0f7a-41ed-883f-4183e0fdc295"}]} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:58:35.668941 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-68fa5691-f675-42b4-b216-54c4b6e60807 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046572 Oct 17 03:58:35.669513 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 358/714] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 17 03:58:35 2022] GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:58:35.671567 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-33355762-5095-493e-b4fb-fa2cc39ac0bf req-7c81ae9c-80c7-4ebb-91b6-83009381ec6e service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:35.672049 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-33355762-5095-493e-b4fb-fa2cc39ac0bf req-7c81ae9c-80c7-4ebb-91b6-83009381ec6e service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:35.672688 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-33355762-5095-493e-b4fb-fa2cc39ac0bf req-7c81ae9c-80c7-4ebb-91b6-83009381ec6e service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:35.683848 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.compute.server_external_events [req-33355762-5095-493e-b4fb-fa2cc39ac0bf req-7c81ae9c-80c7-4ebb-91b6-83009381ec6e service nova] Creating event network-vif-plugged:434914fe-0f7a-41ed-883f-4183e0fdc295 for instance 53df9edf-f0ce-44bd-82fb-378d51d91e67 on hv-cinder-81558 Oct 17 03:58:35.688991 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [req-33355762-5095-493e-b4fb-fa2cc39ac0bf req-7c81ae9c-80c7-4ebb-91b6-83009381ec6e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033216 Oct 17 03:58:35.689572 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 357/715] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 03:58:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 03:58:35.917740 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-41ed5c90-e68f-404f-b44e-f538f8b727d8 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:35.918384 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-41ed5c90-e68f-404f-b44e-f538f8b727d8 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] [instance: 7c191ac7-443c-460d-88b3-5d49f5f733c7] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:35.924634 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-41ed5c90-e68f-404f-b44e-f538f8b727d8 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:35.925138 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-41ed5c90-e68f-404f-b44e-f538f8b727d8 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:35.925575 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-41ed5c90-e68f-404f-b44e-f538f8b727d8 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:35.926273 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-41ed5c90-e68f-404f-b44e-f538f8b727d8 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:35.926727 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-41ed5c90-e68f-404f-b44e-f538f8b727d8 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:35.927154 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-41ed5c90-e68f-404f-b44e-f538f8b727d8 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:36.008209 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-bf05a213-1082-4e10-8566-af8bbc5e744f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:36.008844 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-bf05a213-1082-4e10-8566-af8bbc5e744f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:36.016137 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-bf05a213-1082-4e10-8566-af8bbc5e744f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:36.016631 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-bf05a213-1082-4e10-8566-af8bbc5e744f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:36.017283 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-bf05a213-1082-4e10-8566-af8bbc5e744f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:36.017997 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-bf05a213-1082-4e10-8566-af8bbc5e744f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:36.018453 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-bf05a213-1082-4e10-8566-af8bbc5e744f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:36.018882 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-bf05a213-1082-4e10-8566-af8bbc5e744f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:36.055569 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-41ed5c90-e68f-404f-b44e-f538f8b727d8 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ffc76632a456d9e833381783d4dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed59353a4741cbb901808f7d2210d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:36.063717 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-41ed5c90-e68f-404f-b44e-f538f8b727d8 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] 10.222.0.16 "GET /compute/v2.1/servers/7c191ac7-443c-460d-88b3-5d49f5f733c7" status: 200 len: 1514 microversion: 2.1 time: 0.149778 Oct 17 03:58:36.064291 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 359/716] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:58:35 2022] GET /compute/v2.1/servers/7c191ac7-443c-460d-88b3-5d49f5f733c7 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:58:36.153221 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-bf05a213-1082-4e10-8566-af8bbc5e744f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:36.161311 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-bf05a213-1082-4e10-8566-af8bbc5e744f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:36.162758 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-bf05a213-1082-4e10-8566-af8bbc5e744f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:36.163943 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-bf05a213-1082-4e10-8566-af8bbc5e744f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1723 microversion: 2.20 time: 0.160183 Oct 17 03:58:36.164497 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 358/717] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:58:36 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:58:36.585117 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-617dfbec-106b-43ad-954e-c50d54fe1d7f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:36.585737 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-617dfbec-106b-43ad-954e-c50d54fe1d7f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: 53df9edf-f0ce-44bd-82fb-378d51d91e67] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:36.592345 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-617dfbec-106b-43ad-954e-c50d54fe1d7f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:36.592826 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-617dfbec-106b-43ad-954e-c50d54fe1d7f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:36.593260 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-617dfbec-106b-43ad-954e-c50d54fe1d7f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:36.593945 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-617dfbec-106b-43ad-954e-c50d54fe1d7f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:36.594397 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-617dfbec-106b-43ad-954e-c50d54fe1d7f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:36.594820 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-617dfbec-106b-43ad-954e-c50d54fe1d7f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:36.681210 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-033d0bca-5912-4735-81bb-d5706cd24ebc tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:36.683475 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-033d0bca-5912-4735-81bb-d5706cd24ebc tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 57546995-2ef9-4773-a47a-13cbd2a831a9] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:36.690632 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-033d0bca-5912-4735-81bb-d5706cd24ebc tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:36.691115 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-033d0bca-5912-4735-81bb-d5706cd24ebc tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:36.691576 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-033d0bca-5912-4735-81bb-d5706cd24ebc tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:36.692266 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-033d0bca-5912-4735-81bb-d5706cd24ebc tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:36.692716 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-033d0bca-5912-4735-81bb-d5706cd24ebc tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:36.693133 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-033d0bca-5912-4735-81bb-d5706cd24ebc tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:36.723002 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-033d0bca-5912-4735-81bb-d5706cd24ebc tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045589 Oct 17 03:58:36.728097 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 359/718] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 17 03:58:36 2022] GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 03:58:36.728237 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-617dfbec-106b-43ad-954e-c50d54fe1d7f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:36.732608 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-617dfbec-106b-43ad-954e-c50d54fe1d7f tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67" status: 200 len: 1363 microversion: 2.1 time: 0.151383 Oct 17 03:58:36.733164 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 360/719] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:58:36 2022] GET /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:58:37.087013 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-76367390-db53-4ef0-9f1b-39d41e75c2cb tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:37.087660 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-76367390-db53-4ef0-9f1b-39d41e75c2cb tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] [instance: 7c191ac7-443c-460d-88b3-5d49f5f733c7] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:37.094008 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-76367390-db53-4ef0-9f1b-39d41e75c2cb tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:37.094485 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-76367390-db53-4ef0-9f1b-39d41e75c2cb tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:37.094916 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-76367390-db53-4ef0-9f1b-39d41e75c2cb tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:37.095616 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-76367390-db53-4ef0-9f1b-39d41e75c2cb tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:37.096063 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-76367390-db53-4ef0-9f1b-39d41e75c2cb tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:37.096527 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-76367390-db53-4ef0-9f1b-39d41e75c2cb tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:37.189058 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-5bbe6553-bec3-40f9-87e4-976febfd1f6f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:37.190104 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-5bbe6553-bec3-40f9-87e4-976febfd1f6f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:37.196358 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5bbe6553-bec3-40f9-87e4-976febfd1f6f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:37.196965 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5bbe6553-bec3-40f9-87e4-976febfd1f6f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:37.197378 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5bbe6553-bec3-40f9-87e4-976febfd1f6f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:37.198086 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5bbe6553-bec3-40f9-87e4-976febfd1f6f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:37.198534 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5bbe6553-bec3-40f9-87e4-976febfd1f6f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:37.198953 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5bbe6553-bec3-40f9-87e4-976febfd1f6f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:37.223657 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-76367390-db53-4ef0-9f1b-39d41e75c2cb tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ffc76632a456d9e833381783d4dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed59353a4741cbb901808f7d2210d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:37.231425 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-76367390-db53-4ef0-9f1b-39d41e75c2cb tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] 10.222.0.16 "GET /compute/v2.1/servers/7c191ac7-443c-460d-88b3-5d49f5f733c7" status: 200 len: 1514 microversion: 2.1 time: 0.148163 Oct 17 03:58:37.232000 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 360/720] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:58:37 2022] GET /compute/v2.1/servers/7c191ac7-443c-460d-88b3-5d49f5f733c7 => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:58:37.325446 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-5bbe6553-bec3-40f9-87e4-976febfd1f6f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:37.333375 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-5bbe6553-bec3-40f9-87e4-976febfd1f6f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:37.334816 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-5bbe6553-bec3-40f9-87e4-976febfd1f6f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:37.335998 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-5bbe6553-bec3-40f9-87e4-976febfd1f6f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1723 microversion: 2.20 time: 0.150950 Oct 17 03:58:37.336556 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 361/721] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:58:37 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:58:37.734943 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-f285419f-0b90-48f7-88e7-f80ffe41c34c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:37.737122 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-f285419f-0b90-48f7-88e7-f80ffe41c34c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 57546995-2ef9-4773-a47a-13cbd2a831a9] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:37.743463 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f285419f-0b90-48f7-88e7-f80ffe41c34c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:37.743948 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f285419f-0b90-48f7-88e7-f80ffe41c34c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:37.744375 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f285419f-0b90-48f7-88e7-f80ffe41c34c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:37.745062 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f285419f-0b90-48f7-88e7-f80ffe41c34c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:37.745513 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f285419f-0b90-48f7-88e7-f80ffe41c34c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:37.745932 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f285419f-0b90-48f7-88e7-f80ffe41c34c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:37.755633 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-09d99890-be91-4dff-9540-67c9eecc593b tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:37.756346 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-09d99890-be91-4dff-9540-67c9eecc593b tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: 53df9edf-f0ce-44bd-82fb-378d51d91e67] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:37.763364 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-09d99890-be91-4dff-9540-67c9eecc593b tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:37.764440 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-09d99890-be91-4dff-9540-67c9eecc593b tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:37.764440 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-09d99890-be91-4dff-9540-67c9eecc593b tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:37.765139 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-09d99890-be91-4dff-9540-67c9eecc593b tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:37.765671 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-09d99890-be91-4dff-9540-67c9eecc593b tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:37.766168 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-09d99890-be91-4dff-9540-67c9eecc593b tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:37.776837 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-f285419f-0b90-48f7-88e7-f80ffe41c34c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045765 Oct 17 03:58:37.777403 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 361/722] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 17 03:58:37 2022] GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:58:37.894835 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-09d99890-be91-4dff-9540-67c9eecc593b tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:37.902385 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-09d99890-be91-4dff-9540-67c9eecc593b tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67" status: 200 len: 1363 microversion: 2.1 time: 0.150560 Oct 17 03:58:37.902948 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 362/723] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:58:37 2022] GET /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:58:38.253363 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-8559ea83-7799-4de0-b71e-a373968b754e tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:38.253984 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-8559ea83-7799-4de0-b71e-a373968b754e tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] [instance: 7c191ac7-443c-460d-88b3-5d49f5f733c7] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:38.259943 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8559ea83-7799-4de0-b71e-a373968b754e tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:38.260425 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8559ea83-7799-4de0-b71e-a373968b754e tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:38.260857 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8559ea83-7799-4de0-b71e-a373968b754e tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:38.261541 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8559ea83-7799-4de0-b71e-a373968b754e tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:38.262295 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8559ea83-7799-4de0-b71e-a373968b754e tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:38.262716 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8559ea83-7799-4de0-b71e-a373968b754e tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:38.362261 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-e7070b6e-0279-411b-9dc7-d67f90e14bc3 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:38.362904 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-e7070b6e-0279-411b-9dc7-d67f90e14bc3 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:38.369407 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e7070b6e-0279-411b-9dc7-d67f90e14bc3 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:38.369897 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e7070b6e-0279-411b-9dc7-d67f90e14bc3 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:38.370339 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e7070b6e-0279-411b-9dc7-d67f90e14bc3 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:38.371036 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e7070b6e-0279-411b-9dc7-d67f90e14bc3 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:38.371549 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e7070b6e-0279-411b-9dc7-d67f90e14bc3 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:38.372035 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e7070b6e-0279-411b-9dc7-d67f90e14bc3 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:38.419492 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-8559ea83-7799-4de0-b71e-a373968b754e tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ffc76632a456d9e833381783d4dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed59353a4741cbb901808f7d2210d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:38.419492 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-8559ea83-7799-4de0-b71e-a373968b754e tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] 10.222.0.16 "GET /compute/v2.1/servers/7c191ac7-443c-460d-88b3-5d49f5f733c7" status: 200 len: 1514 microversion: 2.1 time: 0.158080 Oct 17 03:58:38.419492 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 362/724] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:58:38 2022] GET /compute/v2.1/servers/7c191ac7-443c-460d-88b3-5d49f5f733c7 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:58:38.499304 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-e7070b6e-0279-411b-9dc7-d67f90e14bc3 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:38.507348 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-e7070b6e-0279-411b-9dc7-d67f90e14bc3 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:38.508732 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-e7070b6e-0279-411b-9dc7-d67f90e14bc3 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:38.509884 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-e7070b6e-0279-411b-9dc7-d67f90e14bc3 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1723 microversion: 2.20 time: 0.151752 Oct 17 03:58:38.510455 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 363/725] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:58:38 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:58:38.788627 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-385c6464-9100-413a-9981-0c7c94b1dc37 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:38.790764 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-385c6464-9100-413a-9981-0c7c94b1dc37 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 57546995-2ef9-4773-a47a-13cbd2a831a9] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:38.797690 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-385c6464-9100-413a-9981-0c7c94b1dc37 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:38.798174 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-385c6464-9100-413a-9981-0c7c94b1dc37 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:38.798610 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-385c6464-9100-413a-9981-0c7c94b1dc37 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:38.799341 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-385c6464-9100-413a-9981-0c7c94b1dc37 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:38.799799 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-385c6464-9100-413a-9981-0c7c94b1dc37 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:38.800221 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-385c6464-9100-413a-9981-0c7c94b1dc37 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:38.829085 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-385c6464-9100-413a-9981-0c7c94b1dc37 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044495 Oct 17 03:58:38.829628 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 363/726] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 17 03:58:38 2022] GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:58:38.924943 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-dba6e1e6-7a53-4df7-b94f-c92574c22646 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:38.925561 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-dba6e1e6-7a53-4df7-b94f-c92574c22646 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: 53df9edf-f0ce-44bd-82fb-378d51d91e67] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:38.931586 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-dba6e1e6-7a53-4df7-b94f-c92574c22646 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:38.932074 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-dba6e1e6-7a53-4df7-b94f-c92574c22646 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:38.932515 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-dba6e1e6-7a53-4df7-b94f-c92574c22646 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:38.933204 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-dba6e1e6-7a53-4df7-b94f-c92574c22646 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:38.934250 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-dba6e1e6-7a53-4df7-b94f-c92574c22646 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:38.934682 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-dba6e1e6-7a53-4df7-b94f-c92574c22646 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:38.949424 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_cell0:SELECT=4 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:58:39.061620 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-dba6e1e6-7a53-4df7-b94f-c92574c22646 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:39.069271 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-dba6e1e6-7a53-4df7-b94f-c92574c22646 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67" status: 200 len: 1363 microversion: 2.1 time: 0.148218 Oct 17 03:58:39.069840 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 364/727] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:58:38 2022] GET /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:58:39.431490 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-b55b2306-7763-4de2-b3b9-e0b76adb0ce9 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:39.432182 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-b55b2306-7763-4de2-b3b9-e0b76adb0ce9 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] [instance: 7c191ac7-443c-460d-88b3-5d49f5f733c7] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:39.438066 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b55b2306-7763-4de2-b3b9-e0b76adb0ce9 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:39.438545 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b55b2306-7763-4de2-b3b9-e0b76adb0ce9 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:39.438979 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b55b2306-7763-4de2-b3b9-e0b76adb0ce9 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:39.439705 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b55b2306-7763-4de2-b3b9-e0b76adb0ce9 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:39.440153 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b55b2306-7763-4de2-b3b9-e0b76adb0ce9 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:39.440576 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b55b2306-7763-4de2-b3b9-e0b76adb0ce9 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:39.535725 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-196c97f9-e986-4eb6-ab2f-07079cf4a850 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:39.536609 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-196c97f9-e986-4eb6-ab2f-07079cf4a850 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:39.543013 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-196c97f9-e986-4eb6-ab2f-07079cf4a850 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:39.543541 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-196c97f9-e986-4eb6-ab2f-07079cf4a850 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:39.543978 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-196c97f9-e986-4eb6-ab2f-07079cf4a850 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:39.544675 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-196c97f9-e986-4eb6-ab2f-07079cf4a850 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:39.545164 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-196c97f9-e986-4eb6-ab2f-07079cf4a850 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:39.545588 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-196c97f9-e986-4eb6-ab2f-07079cf4a850 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:39.571666 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-b55b2306-7763-4de2-b3b9-e0b76adb0ce9 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ffc76632a456d9e833381783d4dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed59353a4741cbb901808f7d2210d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:39.580239 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-b55b2306-7763-4de2-b3b9-e0b76adb0ce9 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] 10.222.0.16 "GET /compute/v2.1/servers/7c191ac7-443c-460d-88b3-5d49f5f733c7" status: 200 len: 1514 microversion: 2.1 time: 0.152587 Oct 17 03:58:39.580819 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 364/728] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:58:39 2022] GET /compute/v2.1/servers/7c191ac7-443c-460d-88b3-5d49f5f733c7 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:58:39.676241 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-196c97f9-e986-4eb6-ab2f-07079cf4a850 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:39.684507 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-196c97f9-e986-4eb6-ab2f-07079cf4a850 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:39.685957 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-196c97f9-e986-4eb6-ab2f-07079cf4a850 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:39.687108 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-196c97f9-e986-4eb6-ab2f-07079cf4a850 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1723 microversion: 2.20 time: 0.155367 Oct 17 03:58:39.687699 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 365/729] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:58:39 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:58:39.841502 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-ca0def7a-ebf6-43d8-8561-d321be9756c5 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:39.843620 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-ca0def7a-ebf6-43d8-8561-d321be9756c5 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 57546995-2ef9-4773-a47a-13cbd2a831a9] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:39.849993 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ca0def7a-ebf6-43d8-8561-d321be9756c5 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:39.850473 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ca0def7a-ebf6-43d8-8561-d321be9756c5 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:39.850907 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ca0def7a-ebf6-43d8-8561-d321be9756c5 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:39.851616 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ca0def7a-ebf6-43d8-8561-d321be9756c5 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:39.852064 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ca0def7a-ebf6-43d8-8561-d321be9756c5 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:39.852484 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ca0def7a-ebf6-43d8-8561-d321be9756c5 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:39.881047 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-ca0def7a-ebf6-43d8-8561-d321be9756c5 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043606 Oct 17 03:58:39.881587 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 365/730] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 17 03:58:39 2022] GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:58:40.091830 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-77bd741c-b866-4525-9628-a33056f05d7a tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:40.092383 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-77bd741c-b866-4525-9628-a33056f05d7a tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: 53df9edf-f0ce-44bd-82fb-378d51d91e67] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:40.098312 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-77bd741c-b866-4525-9628-a33056f05d7a tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:40.098797 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-77bd741c-b866-4525-9628-a33056f05d7a tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:40.099257 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-77bd741c-b866-4525-9628-a33056f05d7a tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:40.099951 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-77bd741c-b866-4525-9628-a33056f05d7a tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:40.100412 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-77bd741c-b866-4525-9628-a33056f05d7a tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:40.100841 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-77bd741c-b866-4525-9628-a33056f05d7a tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:40.227041 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-77bd741c-b866-4525-9628-a33056f05d7a tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:40.230410 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:58:40.235385 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-77bd741c-b866-4525-9628-a33056f05d7a tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67" status: 200 len: 1363 microversion: 2.1 time: 0.147516 Oct 17 03:58:40.235946 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 366/731] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:58:40 2022] GET /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:58:40.603407 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-6f766ada-a389-4361-a8b9-e2224b008c77 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:40.604026 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-6f766ada-a389-4361-a8b9-e2224b008c77 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] [instance: 7c191ac7-443c-460d-88b3-5d49f5f733c7] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:40.610722 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6f766ada-a389-4361-a8b9-e2224b008c77 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:40.611224 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6f766ada-a389-4361-a8b9-e2224b008c77 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:40.611660 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6f766ada-a389-4361-a8b9-e2224b008c77 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:40.612354 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6f766ada-a389-4361-a8b9-e2224b008c77 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:40.612807 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6f766ada-a389-4361-a8b9-e2224b008c77 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:40.613232 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6f766ada-a389-4361-a8b9-e2224b008c77 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:40.715807 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-d3249552-d265-49d6-89b7-d841e572aca1 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:40.716529 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-d3249552-d265-49d6-89b7-d841e572aca1 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:40.723444 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d3249552-d265-49d6-89b7-d841e572aca1 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:40.724009 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d3249552-d265-49d6-89b7-d841e572aca1 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:40.724655 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d3249552-d265-49d6-89b7-d841e572aca1 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:40.725415 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d3249552-d265-49d6-89b7-d841e572aca1 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:40.725936 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d3249552-d265-49d6-89b7-d841e572aca1 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:40.726422 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d3249552-d265-49d6-89b7-d841e572aca1 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:40.744005 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-6f766ada-a389-4361-a8b9-e2224b008c77 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ffc76632a456d9e833381783d4dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed59353a4741cbb901808f7d2210d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:40.752151 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-6f766ada-a389-4361-a8b9-e2224b008c77 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] 10.222.0.16 "GET /compute/v2.1/servers/7c191ac7-443c-460d-88b3-5d49f5f733c7" status: 200 len: 1514 microversion: 2.1 time: 0.152526 Oct 17 03:58:40.767407 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 366/732] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:58:40 2022] GET /compute/v2.1/servers/7c191ac7-443c-460d-88b3-5d49f5f733c7 => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:58:40.863105 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-d3249552-d265-49d6-89b7-d841e572aca1 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:40.871197 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-d3249552-d265-49d6-89b7-d841e572aca1 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:40.872636 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-d3249552-d265-49d6-89b7-d841e572aca1 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:40.873802 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-d3249552-d265-49d6-89b7-d841e572aca1 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1723 microversion: 2.20 time: 0.163738 Oct 17 03:58:40.874364 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 367/733] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:58:40 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:58:40.893833 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-01fd1721-ce83-45cc-ad47-ce40b52edddb tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:40.896725 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-01fd1721-ce83-45cc-ad47-ce40b52edddb tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 57546995-2ef9-4773-a47a-13cbd2a831a9] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:40.903935 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-01fd1721-ce83-45cc-ad47-ce40b52edddb tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:40.904421 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-01fd1721-ce83-45cc-ad47-ce40b52edddb tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:40.904854 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-01fd1721-ce83-45cc-ad47-ce40b52edddb tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:40.905580 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-01fd1721-ce83-45cc-ad47-ce40b52edddb tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:40.906032 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-01fd1721-ce83-45cc-ad47-ce40b52edddb tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:40.906454 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-01fd1721-ce83-45cc-ad47-ce40b52edddb tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:40.935387 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-01fd1721-ce83-45cc-ad47-ce40b52edddb tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045446 Oct 17 03:58:40.935947 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 367/734] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 17 03:58:40 2022] GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:58:41.125589 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-40e4d27e-230b-4e88-9734-33c9fb1e5350 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:41.126147 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-40e4d27e-230b-4e88-9734-33c9fb1e5350 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 6dabcc62-4829-4f97-830f-e82af447faca] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:41.132279 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-40e4d27e-230b-4e88-9734-33c9fb1e5350 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:41.132766 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-40e4d27e-230b-4e88-9734-33c9fb1e5350 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:41.133313 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-40e4d27e-230b-4e88-9734-33c9fb1e5350 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:41.134038 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-40e4d27e-230b-4e88-9734-33c9fb1e5350 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:41.134496 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-40e4d27e-230b-4e88-9734-33c9fb1e5350 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:41.134920 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-40e4d27e-230b-4e88-9734-33c9fb1e5350 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:41.157473 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-40e4d27e-230b-4e88-9734-33c9fb1e5350 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca/ips" status: 200 len: 149 microversion: 2.1 time: 0.036500 Oct 17 03:58:41.158023 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 368/735] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Oct 17 03:58:41 2022] GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:58:41.258054 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-79f7e6e6-9a1c-453a-a706-c5ca9b2159d1 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:41.258591 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-79f7e6e6-9a1c-453a-a706-c5ca9b2159d1 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: 53df9edf-f0ce-44bd-82fb-378d51d91e67] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:41.266131 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-79f7e6e6-9a1c-453a-a706-c5ca9b2159d1 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:41.266633 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-79f7e6e6-9a1c-453a-a706-c5ca9b2159d1 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:41.267073 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-79f7e6e6-9a1c-453a-a706-c5ca9b2159d1 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:41.267824 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-79f7e6e6-9a1c-453a-a706-c5ca9b2159d1 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:41.268277 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-79f7e6e6-9a1c-453a-a706-c5ca9b2159d1 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:41.268883 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-79f7e6e6-9a1c-453a-a706-c5ca9b2159d1 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:41.284710 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:58:41.537187 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-79f7e6e6-9a1c-453a-a706-c5ca9b2159d1 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:41.545640 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-79f7e6e6-9a1c-453a-a706-c5ca9b2159d1 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67" status: 200 len: 1363 microversion: 2.1 time: 0.291464 Oct 17 03:58:41.546211 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 368/736] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:58:41 2022] GET /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67 => generated 1363 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:58:41.779415 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-afccd2e3-c1ad-4158-a357-b2eb950ac980 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:41.779415 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-afccd2e3-c1ad-4158-a357-b2eb950ac980 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] [instance: 7c191ac7-443c-460d-88b3-5d49f5f733c7] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:41.795428 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-afccd2e3-c1ad-4158-a357-b2eb950ac980 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:41.795428 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-afccd2e3-c1ad-4158-a357-b2eb950ac980 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:41.795428 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-afccd2e3-c1ad-4158-a357-b2eb950ac980 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:41.795428 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-afccd2e3-c1ad-4158-a357-b2eb950ac980 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:41.796382 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-afccd2e3-c1ad-4158-a357-b2eb950ac980 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:41.796382 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-afccd2e3-c1ad-4158-a357-b2eb950ac980 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:41.846929 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [req-1cddba64-778d-419b-8bc7-e696152d3217 req-15d1d9a1-384f-42d1-8a4f-50a2b7917e9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c191ac7-443c-460d-88b3-5d49f5f733c7", "name": "network-vif-deleted", "tag": "9cb8610b-332e-4113-9af2-0a44ec23e97b"}]} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:58:41.859820 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-1cddba64-778d-419b-8bc7-e696152d3217 req-15d1d9a1-384f-42d1-8a4f-50a2b7917e9e service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:41.860287 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-1cddba64-778d-419b-8bc7-e696152d3217 req-15d1d9a1-384f-42d1-8a4f-50a2b7917e9e service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:41.860710 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-1cddba64-778d-419b-8bc7-e696152d3217 req-15d1d9a1-384f-42d1-8a4f-50a2b7917e9e service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:41.893230 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-afccd2e3-c1ad-4158-a357-b2eb950ac980 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ffc76632a456d9e833381783d4dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed59353a4741cbb901808f7d2210d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:41.901770 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-afccd2e3-c1ad-4158-a357-b2eb950ac980 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] 10.222.0.16 "GET /compute/v2.1/servers/7c191ac7-443c-460d-88b3-5d49f5f733c7" status: 200 len: 1472 microversion: 2.1 time: 0.129633 Oct 17 03:58:41.903228 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 369/737] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:58:41 2022] GET /compute/v2.1/servers/7c191ac7-443c-460d-88b3-5d49f5f733c7 => generated 1472 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:58:41.904259 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.compute.server_external_events [req-1cddba64-778d-419b-8bc7-e696152d3217 req-15d1d9a1-384f-42d1-8a4f-50a2b7917e9e service nova] Creating event network-vif-deleted:9cb8610b-332e-4113-9af2-0a44ec23e97b for instance 7c191ac7-443c-460d-88b3-5d49f5f733c7 on hv-cinder-81558 Oct 17 03:58:41.908126 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-b8b81a4f-8dc8-45c9-a9b1-24f5a5c35a66 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:41.908719 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-b8b81a4f-8dc8-45c9-a9b1-24f5a5c35a66 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:41.916431 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b8b81a4f-8dc8-45c9-a9b1-24f5a5c35a66 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:41.916866 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [req-1cddba64-778d-419b-8bc7-e696152d3217 req-15d1d9a1-384f-42d1-8a4f-50a2b7917e9e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074263 Oct 17 03:58:41.919509 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b8b81a4f-8dc8-45c9-a9b1-24f5a5c35a66 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:41.919509 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b8b81a4f-8dc8-45c9-a9b1-24f5a5c35a66 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:41.920056 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 369/738] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 03:58:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:58:41.920236 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b8b81a4f-8dc8-45c9-a9b1-24f5a5c35a66 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:41.920236 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b8b81a4f-8dc8-45c9-a9b1-24f5a5c35a66 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:41.920236 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b8b81a4f-8dc8-45c9-a9b1-24f5a5c35a66 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:41.948535 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-b026f464-0387-4932-8f10-7b1aa828895b tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:41.951418 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-b026f464-0387-4932-8f10-7b1aa828895b tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 57546995-2ef9-4773-a47a-13cbd2a831a9] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:41.957709 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b026f464-0387-4932-8f10-7b1aa828895b tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:41.958262 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b026f464-0387-4932-8f10-7b1aa828895b tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:41.961397 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b026f464-0387-4932-8f10-7b1aa828895b tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:41.962150 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b026f464-0387-4932-8f10-7b1aa828895b tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:41.962689 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b026f464-0387-4932-8f10-7b1aa828895b tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:41.963120 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b026f464-0387-4932-8f10-7b1aa828895b tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:41.995753 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-b026f464-0387-4932-8f10-7b1aa828895b tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051551 Oct 17 03:58:41.996889 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 370/739] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 17 03:58:41 2022] GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 03:58:42.053036 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-b8b81a4f-8dc8-45c9-a9b1-24f5a5c35a66 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:42.061543 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-b8b81a4f-8dc8-45c9-a9b1-24f5a5c35a66 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:42.062983 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-b8b81a4f-8dc8-45c9-a9b1-24f5a5c35a66 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:42.064275 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-b8b81a4f-8dc8-45c9-a9b1-24f5a5c35a66 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1723 microversion: 2.20 time: 0.160129 Oct 17 03:58:42.064836 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 370/740] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:58:41 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:58:42.568781 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-1822323e-77b7-414c-8bc3-ddd5886605fe tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:42.569404 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-1822323e-77b7-414c-8bc3-ddd5886605fe tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: 53df9edf-f0ce-44bd-82fb-378d51d91e67] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:42.576117 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1822323e-77b7-414c-8bc3-ddd5886605fe tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:42.576541 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1822323e-77b7-414c-8bc3-ddd5886605fe tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:42.576973 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1822323e-77b7-414c-8bc3-ddd5886605fe tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:42.577871 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1822323e-77b7-414c-8bc3-ddd5886605fe tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:42.578330 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1822323e-77b7-414c-8bc3-ddd5886605fe tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:42.578757 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1822323e-77b7-414c-8bc3-ddd5886605fe tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:42.725239 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [req-c3c655e2-b4f8-45da-b7a9-be4847f52367 req-7741e751-ff5b-4519-bde2-96d1e3f829df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0982f171-946d-4314-89f2-c139e6bf9adf", "name": "network-vif-deleted", "tag": "8d6b4ea5-ab61-4510-be24-bef55f15afa4"}]} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:58:42.735209 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-c3c655e2-b4f8-45da-b7a9-be4847f52367 req-7741e751-ff5b-4519-bde2-96d1e3f829df service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:42.741783 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-c3c655e2-b4f8-45da-b7a9-be4847f52367 req-7741e751-ff5b-4519-bde2-96d1e3f829df service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:42.741783 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-c3c655e2-b4f8-45da-b7a9-be4847f52367 req-7741e751-ff5b-4519-bde2-96d1e3f829df service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:42.749772 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.compute.server_external_events [req-c3c655e2-b4f8-45da-b7a9-be4847f52367 req-7741e751-ff5b-4519-bde2-96d1e3f829df service nova] Creating event network-vif-deleted:8d6b4ea5-ab61-4510-be24-bef55f15afa4 for instance 0982f171-946d-4314-89f2-c139e6bf9adf on hv-cinder-81558 Oct 17 03:58:42.754978 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [req-c3c655e2-b4f8-45da-b7a9-be4847f52367 req-7741e751-ff5b-4519-bde2-96d1e3f829df service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033291 Oct 17 03:58:42.755843 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 371/741] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 03:58:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 03:58:42.786604 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-1822323e-77b7-414c-8bc3-ddd5886605fe tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:42.794915 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-1822323e-77b7-414c-8bc3-ddd5886605fe tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67" status: 200 len: 1363 microversion: 2.1 time: 0.230046 Oct 17 03:58:42.795681 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 371/742] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:58:42 2022] GET /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67 => generated 1363 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:58:42.929389 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-b4bb1d43-730a-4104-85e7-22a4a4e0689f tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:42.930218 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-b4bb1d43-730a-4104-85e7-22a4a4e0689f tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] [instance: 7c191ac7-443c-460d-88b3-5d49f5f733c7] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:42.937304 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b4bb1d43-730a-4104-85e7-22a4a4e0689f tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:42.937793 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b4bb1d43-730a-4104-85e7-22a4a4e0689f tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:42.942104 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b4bb1d43-730a-4104-85e7-22a4a4e0689f tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:42.942104 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b4bb1d43-730a-4104-85e7-22a4a4e0689f tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:42.942104 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b4bb1d43-730a-4104-85e7-22a4a4e0689f tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:42.942104 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b4bb1d43-730a-4104-85e7-22a4a4e0689f tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:42.942431 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-62ca4cf9-f2ac-417b-8c59-9377f14fe106 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "81dd2a53-4803-4fe5-acc5-aecedf1d2fbc"}} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:58:42.943221 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-62ca4cf9-f2ac-417b-8c59-9377f14fe106 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 6dabcc62-4829-4f97-830f-e82af447faca] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:42.949353 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-62ca4cf9-f2ac-417b-8c59-9377f14fe106 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:42.950199 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-62ca4cf9-f2ac-417b-8c59-9377f14fe106 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:42.950961 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-62ca4cf9-f2ac-417b-8c59-9377f14fe106 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:42.951750 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-62ca4cf9-f2ac-417b-8c59-9377f14fe106 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:42.952413 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-62ca4cf9-f2ac-417b-8c59-9377f14fe106 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:42.953074 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-62ca4cf9-f2ac-417b-8c59-9377f14fe106 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:42.999037 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b4bb1d43-730a-4104-85e7-22a4a4e0689f tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:42.999643 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b4bb1d43-730a-4104-85e7-22a4a4e0689f tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:43.000106 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b4bb1d43-730a-4104-85e7-22a4a4e0689f tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:43.000571 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.objects.instance [None req-b4bb1d43-730a-4104-85e7-22a4a4e0689f tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lazy-loading 'fault' on Instance uuid 7c191ac7-443c-460d-88b3-5d49f5f733c7 {{(pid=125871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:58:43.062293 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-b4bb1d43-730a-4104-85e7-22a4a4e0689f tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ffc76632a456d9e833381783d4dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed59353a4741cbb901808f7d2210d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:43.086362 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-b4bb1d43-730a-4104-85e7-22a4a4e0689f tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] 10.222.0.16 "GET /compute/v2.1/servers/7c191ac7-443c-460d-88b3-5d49f5f733c7" status: 200 len: 1309 microversion: 2.1 time: 0.161103 Oct 17 03:58:43.102833 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 372/743] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:58:42 2022] GET /compute/v2.1/servers/7c191ac7-443c-460d-88b3-5d49f5f733c7 => generated 1309 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:58:43.102833 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-cb7b323f-09df-4537-adea-20e19906eed1 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:43.102833 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-cb7b323f-09df-4537-adea-20e19906eed1 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 57546995-2ef9-4773-a47a-13cbd2a831a9] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:43.103829 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-cb7b323f-09df-4537-adea-20e19906eed1 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:43.104322 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-cb7b323f-09df-4537-adea-20e19906eed1 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:43.104766 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-cb7b323f-09df-4537-adea-20e19906eed1 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:43.105476 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-cb7b323f-09df-4537-adea-20e19906eed1 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:43.106711 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-cb7b323f-09df-4537-adea-20e19906eed1 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:43.107146 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-cb7b323f-09df-4537-adea-20e19906eed1 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:43.146774 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-cb7b323f-09df-4537-adea-20e19906eed1 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056849 Oct 17 03:58:43.147842 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 373/744] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 17 03:58:43 2022] GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 03:58:43.153027 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-0b89f62f-166d-4a72-9b8a-c93eb28d0f44 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:43.162300 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-0b89f62f-166d-4a72-9b8a-c93eb28d0f44 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:43.171899 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0b89f62f-166d-4a72-9b8a-c93eb28d0f44 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:43.172469 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0b89f62f-166d-4a72-9b8a-c93eb28d0f44 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:43.173042 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0b89f62f-166d-4a72-9b8a-c93eb28d0f44 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:43.173872 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0b89f62f-166d-4a72-9b8a-c93eb28d0f44 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:43.174720 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0b89f62f-166d-4a72-9b8a-c93eb28d0f44 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:43.175241 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0b89f62f-166d-4a72-9b8a-c93eb28d0f44 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:43.274929 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-0b89f62f-166d-4a72-9b8a-c93eb28d0f44 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:43.286107 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-0b89f62f-166d-4a72-9b8a-c93eb28d0f44 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:43.287572 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-0b89f62f-166d-4a72-9b8a-c93eb28d0f44 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:43.288810 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-0b89f62f-166d-4a72-9b8a-c93eb28d0f44 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1367 microversion: 2.20 time: 0.139899 Oct 17 03:58:43.289371 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 374/745] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:58:43 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1367 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:58:43.313357 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-a0603408-c0f0-441a-916f-d3ddce935487 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:43.313357 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-a0603408-c0f0-441a-916f-d3ddce935487 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 57546995-2ef9-4773-a47a-13cbd2a831a9] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:43.320961 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a0603408-c0f0-441a-916f-d3ddce935487 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:43.321303 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a0603408-c0f0-441a-916f-d3ddce935487 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:43.321817 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a0603408-c0f0-441a-916f-d3ddce935487 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:43.322571 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a0603408-c0f0-441a-916f-d3ddce935487 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:43.323084 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a0603408-c0f0-441a-916f-d3ddce935487 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:43.323550 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a0603408-c0f0-441a-916f-d3ddce935487 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:43.353967 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-a0603408-c0f0-441a-916f-d3ddce935487 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 57546995-2ef9-4773-a47a-13cbd2a831a9] Going to try to terminate instance {{(pid=125871) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 03:58:43.720930 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-a0603408-c0f0-441a-916f-d3ddce935487 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "DELETE /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9" status: 204 len: 0 microversion: 2.1 time: 0.414254 Oct 17 03:58:43.722105 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 375/746] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 17 03:58:43 2022] DELETE /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 03:58:43.730452 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-f9bea881-c52a-4a05-b298-f123ec94cacd tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:43.731157 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-f9bea881-c52a-4a05-b298-f123ec94cacd tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 57546995-2ef9-4773-a47a-13cbd2a831a9] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:43.737161 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f9bea881-c52a-4a05-b298-f123ec94cacd tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:43.737717 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f9bea881-c52a-4a05-b298-f123ec94cacd tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:43.738160 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f9bea881-c52a-4a05-b298-f123ec94cacd tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:43.738883 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f9bea881-c52a-4a05-b298-f123ec94cacd tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:43.739378 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f9bea881-c52a-4a05-b298-f123ec94cacd tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:43.739810 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f9bea881-c52a-4a05-b298-f123ec94cacd tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:43.837824 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-62ca4cf9-f2ac-417b-8c59-9377f14fe106 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "POST /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.900804 Oct 17 03:58:43.838450 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 372/747] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Oct 17 03:58:42 2022] POST /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca/os-volume_attachments => generated 194 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:58:43.843995 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-9148fd6a-8570-4ac4-aa9a-09390d4d8714 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:43.844743 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-9148fd6a-8570-4ac4-aa9a-09390d4d8714 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: 53df9edf-f0ce-44bd-82fb-378d51d91e67] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:43.851700 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-9148fd6a-8570-4ac4-aa9a-09390d4d8714 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:43.852006 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-9148fd6a-8570-4ac4-aa9a-09390d4d8714 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:43.852443 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-9148fd6a-8570-4ac4-aa9a-09390d4d8714 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:43.853149 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-9148fd6a-8570-4ac4-aa9a-09390d4d8714 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:43.853606 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-9148fd6a-8570-4ac4-aa9a-09390d4d8714 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:43.854028 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-9148fd6a-8570-4ac4-aa9a-09390d4d8714 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:43.886045 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-f9bea881-c52a-4a05-b298-f123ec94cacd tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:43.895680 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-f9bea881-c52a-4a05-b298-f123ec94cacd tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9" status: 200 len: 1690 microversion: 2.1 time: 0.169358 Oct 17 03:58:43.896264 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 376/748] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:58:43 2022] GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9 => generated 1690 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:58:43.991087 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-9148fd6a-8570-4ac4-aa9a-09390d4d8714 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:43.999348 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-9148fd6a-8570-4ac4-aa9a-09390d4d8714 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67" status: 200 len: 1549 microversion: 2.1 time: 0.159737 Oct 17 03:58:43.999912 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 373/749] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:58:43 2022] GET /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67 => generated 1549 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:58:44.021974 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-064eb08a-91df-4b5a-a45a-92c153318c8e tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:44.026764 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-064eb08a-91df-4b5a-a45a-92c153318c8e tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: 53df9edf-f0ce-44bd-82fb-378d51d91e67] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:44.026764 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:58:44.029685 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-064eb08a-91df-4b5a-a45a-92c153318c8e tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:44.030165 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-064eb08a-91df-4b5a-a45a-92c153318c8e tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:44.030617 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-064eb08a-91df-4b5a-a45a-92c153318c8e tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:44.031331 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-064eb08a-91df-4b5a-a45a-92c153318c8e tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:44.031784 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-064eb08a-91df-4b5a-a45a-92c153318c8e tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:44.032206 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-064eb08a-91df-4b5a-a45a-92c153318c8e tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:44.110245 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-46d95c05-6554-4888-b549-873584cbc0ad tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:44.111473 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-46d95c05-6554-4888-b549-873584cbc0ad tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] [instance: 7c191ac7-443c-460d-88b3-5d49f5f733c7] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:44.116793 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-46d95c05-6554-4888-b549-873584cbc0ad tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:44.117467 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-46d95c05-6554-4888-b549-873584cbc0ad tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:44.117906 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-46d95c05-6554-4888-b549-873584cbc0ad tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:44.118610 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-46d95c05-6554-4888-b549-873584cbc0ad tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:44.119268 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-46d95c05-6554-4888-b549-873584cbc0ad tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:44.119696 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-46d95c05-6554-4888-b549-873584cbc0ad tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:44.150907 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-46d95c05-6554-4888-b549-873584cbc0ad tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:44.151428 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-46d95c05-6554-4888-b549-873584cbc0ad tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:44.151865 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-46d95c05-6554-4888-b549-873584cbc0ad tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:44.152309 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.objects.instance [None req-46d95c05-6554-4888-b549-873584cbc0ad tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lazy-loading 'fault' on Instance uuid 7c191ac7-443c-460d-88b3-5d49f5f733c7 {{(pid=125872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:58:44.157444 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-064eb08a-91df-4b5a-a45a-92c153318c8e tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.139273 Oct 17 03:58:44.158322 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 377/750] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Oct 17 03:58:44 2022] GET /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67/os-interface => generated 284 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:58:44.247724 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-46d95c05-6554-4888-b549-873584cbc0ad tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ffc76632a456d9e833381783d4dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed59353a4741cbb901808f7d2210d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:44.255980 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-46d95c05-6554-4888-b549-873584cbc0ad tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] 10.222.0.16 "GET /compute/v2.1/servers/7c191ac7-443c-460d-88b3-5d49f5f733c7" status: 200 len: 1309 microversion: 2.1 time: 0.150000 Oct 17 03:58:44.256553 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 374/751] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:58:44 2022] GET /compute/v2.1/servers/7c191ac7-443c-460d-88b3-5d49f5f733c7 => generated 1309 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:58:44.318182 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-1cfe7b49-e154-4ff9-a7f2-1b9f40e5f41d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:44.318828 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-1cfe7b49-e154-4ff9-a7f2-1b9f40e5f41d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:44.325108 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1cfe7b49-e154-4ff9-a7f2-1b9f40e5f41d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:44.325605 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1cfe7b49-e154-4ff9-a7f2-1b9f40e5f41d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:44.326042 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1cfe7b49-e154-4ff9-a7f2-1b9f40e5f41d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:44.326747 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1cfe7b49-e154-4ff9-a7f2-1b9f40e5f41d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:44.327241 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1cfe7b49-e154-4ff9-a7f2-1b9f40e5f41d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:44.327645 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1cfe7b49-e154-4ff9-a7f2-1b9f40e5f41d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:44.362557 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1cfe7b49-e154-4ff9-a7f2-1b9f40e5f41d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:44.363051 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1cfe7b49-e154-4ff9-a7f2-1b9f40e5f41d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:44.363518 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1cfe7b49-e154-4ff9-a7f2-1b9f40e5f41d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:44.363972 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.objects.instance [None req-1cfe7b49-e154-4ff9-a7f2-1b9f40e5f41d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lazy-loading 'fault' on Instance uuid 0982f171-946d-4314-89f2-c139e6bf9adf {{(pid=125871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:58:44.579636 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-1cfe7b49-e154-4ff9-a7f2-1b9f40e5f41d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:44.587719 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-1cfe7b49-e154-4ff9-a7f2-1b9f40e5f41d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:44.589154 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-1cfe7b49-e154-4ff9-a7f2-1b9f40e5f41d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:44.590807 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-1cfe7b49-e154-4ff9-a7f2-1b9f40e5f41d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1372 microversion: 2.20 time: 0.276117 Oct 17 03:58:44.594277 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 378/752] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:58:44 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1372 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:58:44.919842 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-16e42373-6c27-4625-a759-b6a75ed371ff tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:44.919842 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-16e42373-6c27-4625-a759-b6a75ed371ff tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 57546995-2ef9-4773-a47a-13cbd2a831a9] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:44.926195 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-16e42373-6c27-4625-a759-b6a75ed371ff tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:44.926682 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-16e42373-6c27-4625-a759-b6a75ed371ff tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:44.927110 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-16e42373-6c27-4625-a759-b6a75ed371ff tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:44.927873 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-16e42373-6c27-4625-a759-b6a75ed371ff tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:44.928326 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-16e42373-6c27-4625-a759-b6a75ed371ff tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:44.928748 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-16e42373-6c27-4625-a759-b6a75ed371ff tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:45.060297 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-16e42373-6c27-4625-a759-b6a75ed371ff tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:45.068013 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-16e42373-6c27-4625-a759-b6a75ed371ff tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9" status: 200 len: 1690 microversion: 2.1 time: 0.153090 Oct 17 03:58:45.068610 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 375/753] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:58:44 2022] GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9 => generated 1690 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:58:45.279127 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-36f3f500-5a1d-4fe8-a9c0-30f55ef825ff tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:45.279798 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-36f3f500-5a1d-4fe8-a9c0-30f55ef825ff tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] [instance: 7c191ac7-443c-460d-88b3-5d49f5f733c7] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:45.286083 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-36f3f500-5a1d-4fe8-a9c0-30f55ef825ff tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:45.286562 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-36f3f500-5a1d-4fe8-a9c0-30f55ef825ff tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:45.287070 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-36f3f500-5a1d-4fe8-a9c0-30f55ef825ff tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:45.287784 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-36f3f500-5a1d-4fe8-a9c0-30f55ef825ff tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:45.288232 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-36f3f500-5a1d-4fe8-a9c0-30f55ef825ff tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:45.288652 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-36f3f500-5a1d-4fe8-a9c0-30f55ef825ff tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:45.321063 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-36f3f500-5a1d-4fe8-a9c0-30f55ef825ff tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:45.321550 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-36f3f500-5a1d-4fe8-a9c0-30f55ef825ff tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:45.323904 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-36f3f500-5a1d-4fe8-a9c0-30f55ef825ff tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:45.325008 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.objects.instance [None req-36f3f500-5a1d-4fe8-a9c0-30f55ef825ff tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lazy-loading 'fault' on Instance uuid 7c191ac7-443c-460d-88b3-5d49f5f733c7 {{(pid=125871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:58:45.383610 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-36f3f500-5a1d-4fe8-a9c0-30f55ef825ff tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ffc76632a456d9e833381783d4dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed59353a4741cbb901808f7d2210d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:45.392303 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-36f3f500-5a1d-4fe8-a9c0-30f55ef825ff tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] 10.222.0.16 "GET /compute/v2.1/servers/7c191ac7-443c-460d-88b3-5d49f5f733c7" status: 200 len: 1309 microversion: 2.1 time: 0.116984 Oct 17 03:58:45.392886 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 379/754] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:58:45 2022] GET /compute/v2.1/servers/7c191ac7-443c-460d-88b3-5d49f5f733c7 => generated 1309 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:58:45.441727 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [req-e94cb3c3-0d6c-42ce-804c-5a2984e7c1d6 req-e397de8b-801d-425f-b74a-04aeee6ee286 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53df9edf-f0ce-44bd-82fb-378d51d91e67", "tag": "434914fe-0f7a-41ed-883f-4183e0fdc295"}]} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:58:45.451328 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-e94cb3c3-0d6c-42ce-804c-5a2984e7c1d6 req-e397de8b-801d-425f-b74a-04aeee6ee286 service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:45.452062 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-e94cb3c3-0d6c-42ce-804c-5a2984e7c1d6 req-e397de8b-801d-425f-b74a-04aeee6ee286 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:45.452195 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-e94cb3c3-0d6c-42ce-804c-5a2984e7c1d6 req-e397de8b-801d-425f-b74a-04aeee6ee286 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:45.463532 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.compute.server_external_events [req-e94cb3c3-0d6c-42ce-804c-5a2984e7c1d6 req-e397de8b-801d-425f-b74a-04aeee6ee286 service nova] Creating event network-changed:434914fe-0f7a-41ed-883f-4183e0fdc295 for instance 53df9edf-f0ce-44bd-82fb-378d51d91e67 on hv-cinder-81558 Oct 17 03:58:45.468704 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [req-e94cb3c3-0d6c-42ce-804c-5a2984e7c1d6 req-e397de8b-801d-425f-b74a-04aeee6ee286 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030673 Oct 17 03:58:45.472289 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 376/755] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 03:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:58:45.616894 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-c7b2896f-5d8b-4525-8d2a-3b2d031486af tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:45.617801 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-c7b2896f-5d8b-4525-8d2a-3b2d031486af tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:45.624511 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c7b2896f-5d8b-4525-8d2a-3b2d031486af tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:45.624990 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c7b2896f-5d8b-4525-8d2a-3b2d031486af tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:45.625429 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c7b2896f-5d8b-4525-8d2a-3b2d031486af tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:45.626115 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c7b2896f-5d8b-4525-8d2a-3b2d031486af tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:45.626601 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c7b2896f-5d8b-4525-8d2a-3b2d031486af tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:45.627023 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c7b2896f-5d8b-4525-8d2a-3b2d031486af tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:45.657017 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c7b2896f-5d8b-4525-8d2a-3b2d031486af tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:45.657749 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c7b2896f-5d8b-4525-8d2a-3b2d031486af tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:45.658186 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c7b2896f-5d8b-4525-8d2a-3b2d031486af tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:45.658633 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.objects.instance [None req-c7b2896f-5d8b-4525-8d2a-3b2d031486af tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lazy-loading 'fault' on Instance uuid 0982f171-946d-4314-89f2-c139e6bf9adf {{(pid=125871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:58:45.700251 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-c7b2896f-5d8b-4525-8d2a-3b2d031486af tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:45.708471 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-c7b2896f-5d8b-4525-8d2a-3b2d031486af tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:45.709917 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-c7b2896f-5d8b-4525-8d2a-3b2d031486af tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:45.711103 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-c7b2896f-5d8b-4525-8d2a-3b2d031486af tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 200 len: 1372 microversion: 2.20 time: 0.098300 Oct 17 03:58:45.711777 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 380/756] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:58:45 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 1372 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:58:46.092005 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-436c926f-4cc4-42fe-96c6-cef3ca6462be tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:46.092700 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-436c926f-4cc4-42fe-96c6-cef3ca6462be tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 57546995-2ef9-4773-a47a-13cbd2a831a9] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:46.098842 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-436c926f-4cc4-42fe-96c6-cef3ca6462be tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:46.099364 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-436c926f-4cc4-42fe-96c6-cef3ca6462be tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:46.099796 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-436c926f-4cc4-42fe-96c6-cef3ca6462be tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:46.100487 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-436c926f-4cc4-42fe-96c6-cef3ca6462be tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:46.100935 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-436c926f-4cc4-42fe-96c6-cef3ca6462be tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:46.101356 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-436c926f-4cc4-42fe-96c6-cef3ca6462be tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:46.233899 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-436c926f-4cc4-42fe-96c6-cef3ca6462be tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:46.241652 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-436c926f-4cc4-42fe-96c6-cef3ca6462be tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9" status: 200 len: 1690 microversion: 2.1 time: 0.154391 Oct 17 03:58:46.242867 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 377/757] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:58:46 2022] GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9 => generated 1690 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:58:46.414842 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-98477813-1542-453d-b942-f62edfc9b0ba tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:46.415474 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-98477813-1542-453d-b942-f62edfc9b0ba tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] [instance: 7c191ac7-443c-460d-88b3-5d49f5f733c7] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:46.422398 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-98477813-1542-453d-b942-f62edfc9b0ba tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:46.422875 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-98477813-1542-453d-b942-f62edfc9b0ba tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:46.423338 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-98477813-1542-453d-b942-f62edfc9b0ba tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:46.424036 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-98477813-1542-453d-b942-f62edfc9b0ba tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:46.424485 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-98477813-1542-453d-b942-f62edfc9b0ba tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:46.424902 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-98477813-1542-453d-b942-f62edfc9b0ba tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:46.455604 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-98477813-1542-453d-b942-f62edfc9b0ba tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:46.456078 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-98477813-1542-453d-b942-f62edfc9b0ba tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:46.456505 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-98477813-1542-453d-b942-f62edfc9b0ba tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:46.456951 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.objects.instance [None req-98477813-1542-453d-b942-f62edfc9b0ba tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lazy-loading 'fault' on Instance uuid 7c191ac7-443c-460d-88b3-5d49f5f733c7 {{(pid=125871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:58:46.459577 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:58:46.497811 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-98477813-1542-453d-b942-f62edfc9b0ba tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ffc76632a456d9e833381783d4dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed59353a4741cbb901808f7d2210d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:46.505814 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-98477813-1542-453d-b942-f62edfc9b0ba tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] 10.222.0.16 "GET /compute/v2.1/servers/7c191ac7-443c-460d-88b3-5d49f5f733c7" status: 200 len: 1309 microversion: 2.1 time: 0.094872 Oct 17 03:58:46.506371 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 381/758] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:58:46 2022] GET /compute/v2.1/servers/7c191ac7-443c-460d-88b3-5d49f5f733c7 => generated 1309 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:58:46.736993 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-39e4c5b7-6d9f-4b5d-9d0e-62df9d5c9c8b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:46.737602 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-39e4c5b7-6d9f-4b5d-9d0e-62df9d5c9c8b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:46.743697 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-39e4c5b7-6d9f-4b5d-9d0e-62df9d5c9c8b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:46.744172 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-39e4c5b7-6d9f-4b5d-9d0e-62df9d5c9c8b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:46.744603 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-39e4c5b7-6d9f-4b5d-9d0e-62df9d5c9c8b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:46.745354 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-39e4c5b7-6d9f-4b5d-9d0e-62df9d5c9c8b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:46.745757 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-39e4c5b7-6d9f-4b5d-9d0e-62df9d5c9c8b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:46.746198 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-39e4c5b7-6d9f-4b5d-9d0e-62df9d5c9c8b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:46.761350 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.wsgi [None req-39e4c5b7-6d9f-4b5d-9d0e-62df9d5c9c8b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] HTTP exception thrown: Instance 0982f171-946d-4314-89f2-c139e6bf9adf could not be found. Oct 17 03:58:46.763318 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-39e4c5b7-6d9f-4b5d-9d0e-62df9d5c9c8b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Request method failure captured: Oct 17 03:58:46.763318 dv-cinder-815582-16-smb devstack@n-api.service[125872]: request: GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf HTTP/1.1 Oct 17 03:58:46.763318 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Accept: application/json Oct 17 03:58:46.763318 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Accept-Encoding: identity Oct 17 03:58:46.763318 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Connection: close Oct 17 03:58:46.763318 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Content-Length: 0 Oct 17 03:58:46.763318 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Content-Type: application/json Oct 17 03:58:46.763318 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Host: 10.222.0.16 Oct 17 03:58:46.763318 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Openstack-System-Scope: None Oct 17 03:58:46.763318 dv-cinder-815582-16-smb devstack@n-api.service[125872]: User-Agent: python-urllib3/1.26.12 Oct 17 03:58:46.763318 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Auth-Token: gAAAAABjTNIfzfnfmWkMHvBxR2mN22jJ3POuCUUIzn-IRWM1bgN5ZquLGdB_CZMe9aZfDERBL4l0zV3ez1mejdg2GIcxV3KbJ4y2MPhGNW4ETthpFHK__eMgAUq4xi_0AyAq2jFPQ8FnHVgFK3v8-BNe07aI9YNG65Qgj4loEcoGjf5VYTsM-0g Oct 17 03:58:46.763318 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Domain-Id: None Oct 17 03:58:46.763318 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Domain-Name: None Oct 17 03:58:46.763318 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Identity-Status: Confirmed Oct 17 03:58:46.763318 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Is-Admin-Project: True Oct 17 03:58:46.763318 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Openstack-Nova-Api-Version: 2.20 Oct 17 03:58:46.763318 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Domain-Id: default Oct 17 03:58:46.763318 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Domain-Name: Default Oct 17 03:58:46.763318 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Id: 2301e8558e0148a481982b776c91e839 Oct 17 03:58:46.763318 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-83438865 Oct 17 03:58:46.763318 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Role: reader,member Oct 17 03:58:46.763318 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Roles: reader,member Oct 17 03:58:46.764891 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2301e8558e0148a481982b776c91e839"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2301e8558e0148a481982b776c91e839"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2301e8558e0148a481982b776c91e839"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2301e8558e0148a481982b776c91e839", "adminURL": "http://10.222.0.16:8080"}]}] Oct 17 03:58:46.764891 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant: tempest-AttachVolumeShelveTestJSON-83438865 Oct 17 03:58:46.764891 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant-Id: 2301e8558e0148a481982b776c91e839 Oct 17 03:58:46.764891 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-83438865 Oct 17 03:58:46.764891 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User: tempest-AttachVolumeShelveTestJSON-83438865-project Oct 17 03:58:46.764891 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Domain-Id: default Oct 17 03:58:46.764891 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Domain-Name: Default Oct 17 03:58:46.764891 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Id: 67fe62eeb9d043a59baa93def8d43265 Oct 17 03:58:46.764891 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Name: tempest-AttachVolumeShelveTestJSON-83438865-project Oct 17 03:58:46.764891 dv-cinder-815582-16-smb devstack@n-api.service[125872]: method: > Oct 17 03:58:46.764891 dv-cinder-815582-16-smb devstack@n-api.service[125872]: exception: Instance 0982f171-946d-4314-89f2-c139e6bf9adf could not be found. Oct 17 03:58:46.764891 dv-cinder-815582-16-smb devstack@n-api.service[125872]: action_args: {'id': '0982f171-946d-4314-89f2-c139e6bf9adf'} Oct 17 03:58:46.765763 dv-cinder-815582-16-smb devstack@n-api.service[125872]: {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:58:46.765763 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:58:46.765763 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 03:58:46.765763 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 03:58:46.765763 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 03:58:46.765763 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 03:58:46.765763 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 03:58:46.765763 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 03:58:46.765763 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 03:58:46.765763 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 03:58:46.765763 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0982f171-946d-4314-89f2-c139e6bf9adf could not be found. Oct 17 03:58:46.765763 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:58:46.765763 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:58:46.765763 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:58:46.765763 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:58:46.765763 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:58:46.765763 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:58:46.765763 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:58:46.765763 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:58:46.765763 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:58:46.767006 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:58:46.767006 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 03:58:46.767006 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 03:58:46.767006 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 03:58:46.767006 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 03:58:46.767006 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 03:58:46.767006 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:58:46.767006 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0982f171-946d-4314-89f2-c139e6bf9adf could not be found. Oct 17 03:58:46.767006 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:58:46.767006 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:58:46.767006 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:58:46.767006 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:58:46.767006 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:58:46.767006 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:58:46.767006 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:58:46.767006 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:58:46.767006 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0982f171-946d-4314-89f2-c139e6bf9adf could not be found. Oct 17 03:58:46.767006 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:58:46.768146 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-39e4c5b7-6d9f-4b5d-9d0e-62df9d5c9c8b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Returning 404 to user: Instance 0982f171-946d-4314-89f2-c139e6bf9adf could not be found. {{(pid=125872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:58:46.768146 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-39e4c5b7-6d9f-4b5d-9d0e-62df9d5c9c8b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 404 len: 111 microversion: 2.20 time: 0.031701 Oct 17 03:58:46.768146 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 378/759] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:58:46 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 03:58:46.773907 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-2a541ad3-ff40-4ceb-b9d6-c3e119b25d83 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '.version_select at 0x7fd72a5d9dc0>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:46.869005 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-2a541ad3-ff40-4ceb-b9d6-c3e119b25d83 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1729030792" status: 204 len: 0 microversion: 2.20 time: 0.099045 Oct 17 03:58:46.869688 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 382/760] 10.222.0.16 () {60 vars in 1262 bytes} [Mon Oct 17 03:58:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1729030792 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 03:58:47.266015 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-1cae235d-44a1-4faf-90ac-78aca2b5a440 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:47.266722 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-1cae235d-44a1-4faf-90ac-78aca2b5a440 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 57546995-2ef9-4773-a47a-13cbd2a831a9] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:47.276156 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1cae235d-44a1-4faf-90ac-78aca2b5a440 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:47.277149 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1cae235d-44a1-4faf-90ac-78aca2b5a440 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:47.277619 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1cae235d-44a1-4faf-90ac-78aca2b5a440 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:47.278329 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1cae235d-44a1-4faf-90ac-78aca2b5a440 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:47.278864 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1cae235d-44a1-4faf-90ac-78aca2b5a440 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:47.279671 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1cae235d-44a1-4faf-90ac-78aca2b5a440 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:47.530068 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-7d7fe03b-edc0-45db-b92e-5758d80683a8 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:47.531359 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-7d7fe03b-edc0-45db-b92e-5758d80683a8 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] [instance: 7c191ac7-443c-460d-88b3-5d49f5f733c7] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:47.537664 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7d7fe03b-edc0-45db-b92e-5758d80683a8 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:47.538219 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7d7fe03b-edc0-45db-b92e-5758d80683a8 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:47.538658 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7d7fe03b-edc0-45db-b92e-5758d80683a8 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:47.539385 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7d7fe03b-edc0-45db-b92e-5758d80683a8 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:47.540018 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7d7fe03b-edc0-45db-b92e-5758d80683a8 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:47.540444 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7d7fe03b-edc0-45db-b92e-5758d80683a8 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:47.548204 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-1cae235d-44a1-4faf-90ac-78aca2b5a440 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:47.556665 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.wsgi [None req-7d7fe03b-edc0-45db-b92e-5758d80683a8 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] HTTP exception thrown: Instance 7c191ac7-443c-460d-88b3-5d49f5f733c7 could not be found. Oct 17 03:58:47.556836 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-1cae235d-44a1-4faf-90ac-78aca2b5a440 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9" status: 200 len: 1690 microversion: 2.1 time: 0.295296 Oct 17 03:58:47.557649 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 379/761] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:58:47 2022] GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9 => generated 1690 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:58:47.565575 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-7d7fe03b-edc0-45db-b92e-5758d80683a8 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Request method failure captured: Oct 17 03:58:47.565575 dv-cinder-815582-16-smb devstack@n-api.service[125871]: request: GET /compute/v2.1/servers/7c191ac7-443c-460d-88b3-5d49f5f733c7 HTTP/1.1 Oct 17 03:58:47.565575 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Accept: application/json Oct 17 03:58:47.565575 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Accept-Encoding: identity Oct 17 03:58:47.565575 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Connection: close Oct 17 03:58:47.565575 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Content-Length: 0 Oct 17 03:58:47.565575 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Content-Type: application/json Oct 17 03:58:47.565575 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Host: 10.222.0.16 Oct 17 03:58:47.565575 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Openstack-System-Scope: None Oct 17 03:58:47.565575 dv-cinder-815582-16-smb devstack@n-api.service[125871]: User-Agent: python-urllib3/1.26.12 Oct 17 03:58:47.565575 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Auth-Token: gAAAAABjTNJXx73OaFsOkts5_8d4OIVOo-yMRjx5qSMqgK45YFQ83ehknY221EKopQZVDKZ0Cqrr0Vf8pXswQpZdWU2j7XxL1BUpjJZrFO8SjR0kMkZLbPIx5moZwQ6cdCxOcUxXKn7p3YbzcTIyqrxtC0fL-uiHWOMXnxejxYPoU0BxWDjBhZM Oct 17 03:58:47.565575 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Domain-Id: None Oct 17 03:58:47.565575 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Domain-Name: None Oct 17 03:58:47.565575 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Identity-Status: Confirmed Oct 17 03:58:47.565575 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Is-Admin-Project: True Oct 17 03:58:47.565575 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Domain-Id: default Oct 17 03:58:47.565575 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Domain-Name: Default Oct 17 03:58:47.565575 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Id: f9ed59353a4741cbb901808f7d2210d0 Oct 17 03:58:47.565575 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2080633967 Oct 17 03:58:47.565575 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Role: reader,member Oct 17 03:58:47.565575 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Roles: reader,member Oct 17 03:58:47.566945 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f9ed59353a4741cbb901808f7d2210d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f9ed59353a4741cbb901808f7d2210d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f9ed59353a4741cbb901808f7d2210d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f9ed59353a4741cbb901808f7d2210d0", "adminURL": "http://10.222.0.16:8080"}]}] Oct 17 03:58:47.566945 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant: tempest-VolumesSnapshotTestJSON-2080633967 Oct 17 03:58:47.566945 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant-Id: f9ed59353a4741cbb901808f7d2210d0 Oct 17 03:58:47.566945 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2080633967 Oct 17 03:58:47.566945 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User: tempest-VolumesSnapshotTestJSON-2080633967-project Oct 17 03:58:47.566945 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Domain-Id: default Oct 17 03:58:47.566945 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Domain-Name: Default Oct 17 03:58:47.566945 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Id: c53ffc76632a456d9e833381783d4dd8 Oct 17 03:58:47.566945 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Name: tempest-VolumesSnapshotTestJSON-2080633967-project Oct 17 03:58:47.566945 dv-cinder-815582-16-smb devstack@n-api.service[125871]: method: > Oct 17 03:58:47.566945 dv-cinder-815582-16-smb devstack@n-api.service[125871]: exception: Instance 7c191ac7-443c-460d-88b3-5d49f5f733c7 could not be found. Oct 17 03:58:47.566945 dv-cinder-815582-16-smb devstack@n-api.service[125871]: action_args: {'id': '7c191ac7-443c-460d-88b3-5d49f5f733c7'} Oct 17 03:58:47.567776 dv-cinder-815582-16-smb devstack@n-api.service[125871]: {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:58:47.567776 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:58:47.567776 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 03:58:47.567776 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 03:58:47.567776 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 03:58:47.567776 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 03:58:47.567776 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 03:58:47.567776 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 03:58:47.567776 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 03:58:47.567776 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 03:58:47.567776 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c191ac7-443c-460d-88b3-5d49f5f733c7 could not be found. Oct 17 03:58:47.567776 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:58:47.567776 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:58:47.567776 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:58:47.567776 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:58:47.567776 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:58:47.567776 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:58:47.567776 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:58:47.567776 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:58:47.567776 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:58:47.569319 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:58:47.569319 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 03:58:47.569319 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 03:58:47.569319 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 03:58:47.569319 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 03:58:47.569319 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 03:58:47.569319 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:58:47.569319 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c191ac7-443c-460d-88b3-5d49f5f733c7 could not be found. Oct 17 03:58:47.569319 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:58:47.569319 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:58:47.569319 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:58:47.569319 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:58:47.569319 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:58:47.569319 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:58:47.569319 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:58:47.569319 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:58:47.569319 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c191ac7-443c-460d-88b3-5d49f5f733c7 could not be found. Oct 17 03:58:47.569319 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:58:47.570644 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-7d7fe03b-edc0-45db-b92e-5758d80683a8 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] Returning 404 to user: Instance 7c191ac7-443c-460d-88b3-5d49f5f733c7 could not be found. {{(pid=125871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:58:47.570644 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-7d7fe03b-edc0-45db-b92e-5758d80683a8 tempest-VolumesSnapshotTestJSON-2080633967 tempest-VolumesSnapshotTestJSON-2080633967-project] 10.222.0.16 "GET /compute/v2.1/servers/7c191ac7-443c-460d-88b3-5d49f5f733c7" status: 404 len: 111 microversion: 2.1 time: 0.042396 Oct 17 03:58:47.571448 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 383/762] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:58:47 2022] GET /compute/v2.1/servers/7c191ac7-443c-460d-88b3-5d49f5f733c7 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 03:58:47.917105 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [req-143b947a-b453-4752-ac76-5096114a390e req-3d957e36-622d-4cef-81a2-f60c606a75b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57546995-2ef9-4773-a47a-13cbd2a831a9", "name": "network-vif-deleted", "tag": "6d4fd674-8999-42dd-8bcb-abfcc7aaca39"}]} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:58:47.928052 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-143b947a-b453-4752-ac76-5096114a390e req-3d957e36-622d-4cef-81a2-f60c606a75b0 service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:47.928738 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-143b947a-b453-4752-ac76-5096114a390e req-3d957e36-622d-4cef-81a2-f60c606a75b0 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:47.939239 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-143b947a-b453-4752-ac76-5096114a390e req-3d957e36-622d-4cef-81a2-f60c606a75b0 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:47.949787 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-20505938-a199-4974-a8d0-57f2015b9967 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Action: 'create', calling method: .version_select at 0x7fd72a5ade50>, body: {"keypair": {"name": "tempest-keypair-797351937", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKv+whJaoYFVbSCIgWVKa/T01nvS436hufUvZ5HqEImFHf40eREpKX8BDJmanbPr6mAFs47DIx3iILEGIOklDVryr73FFFcoAPDahZLGWr+QpbBnsVsuF1rRu9mqif5mGQ=="}} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:58:47.950016 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.compute.server_external_events [req-143b947a-b453-4752-ac76-5096114a390e req-3d957e36-622d-4cef-81a2-f60c606a75b0 service nova] Creating event network-vif-deleted:6d4fd674-8999-42dd-8bcb-abfcc7aaca39 for instance 57546995-2ef9-4773-a47a-13cbd2a831a9 on hv-cinder-81558 Oct 17 03:58:47.963338 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [req-143b947a-b453-4752-ac76-5096114a390e req-3d957e36-622d-4cef-81a2-f60c606a75b0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042172 Oct 17 03:58:47.966567 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 380/763] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 03:58:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:58:47.974522 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.quota [None req-20505938-a199-4974-a8d0-57f2015b9967 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Getting quotas for project 2301e8558e0148a481982b776c91e839. Resources: {'key_pairs'} {{(pid=125871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 03:58:47.978709 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.quota [None req-20505938-a199-4974-a8d0-57f2015b9967 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Getting quotas for user 67fe62eeb9d043a59baa93def8d43265 and project 2301e8558e0148a481982b776c91e839. Resources: {'key_pairs'} {{(pid=125871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 03:58:48.063644 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-20505938-a199-4974-a8d0-57f2015b9967 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.118323 Oct 17 03:58:48.064686 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 384/764] 10.222.0.16 () {62 vars in 1200 bytes} [Mon Oct 17 03:58:47 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 120 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 17 03:58:48.584692 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-82c2eba5-9cfb-45c9-966e-0216bfc78cda tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:48.585554 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-82c2eba5-9cfb-45c9-966e-0216bfc78cda tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 57546995-2ef9-4773-a47a-13cbd2a831a9] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:48.592335 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-82c2eba5-9cfb-45c9-966e-0216bfc78cda tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:48.592818 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-82c2eba5-9cfb-45c9-966e-0216bfc78cda tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:48.593680 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-82c2eba5-9cfb-45c9-966e-0216bfc78cda tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:48.594554 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-82c2eba5-9cfb-45c9-966e-0216bfc78cda tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:48.595195 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-82c2eba5-9cfb-45c9-966e-0216bfc78cda tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:48.595619 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-82c2eba5-9cfb-45c9-966e-0216bfc78cda tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:48.640319 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-82c2eba5-9cfb-45c9-966e-0216bfc78cda tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:48.640806 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-82c2eba5-9cfb-45c9-966e-0216bfc78cda tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:48.641420 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-82c2eba5-9cfb-45c9-966e-0216bfc78cda tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:48.642023 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.objects.instance [None req-82c2eba5-9cfb-45c9-966e-0216bfc78cda tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lazy-loading 'fault' on Instance uuid 57546995-2ef9-4773-a47a-13cbd2a831a9 {{(pid=125872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:58:48.691824 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-82c2eba5-9cfb-45c9-966e-0216bfc78cda tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:48.701286 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-82c2eba5-9cfb-45c9-966e-0216bfc78cda tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9" status: 200 len: 1335 microversion: 2.1 time: 0.121688 Oct 17 03:58:48.701965 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 381/765] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:58:48 2022] GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9 => generated 1335 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:58:49.297409 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-1c1821da-27f6-4174-8cba-a9e8d1ab72ff tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "81dd2a53-4803-4fe5-acc5-aecedf1d2fbc"}} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:58:49.299285 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-1c1821da-27f6-4174-8cba-a9e8d1ab72ff tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 6dabcc62-4829-4f97-830f-e82af447faca] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:49.311999 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1c1821da-27f6-4174-8cba-a9e8d1ab72ff tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:49.311999 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1c1821da-27f6-4174-8cba-a9e8d1ab72ff tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:49.312404 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1c1821da-27f6-4174-8cba-a9e8d1ab72ff tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:49.313089 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1c1821da-27f6-4174-8cba-a9e8d1ab72ff tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:49.313444 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1c1821da-27f6-4174-8cba-a9e8d1ab72ff tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:49.313872 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1c1821da-27f6-4174-8cba-a9e8d1ab72ff tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:49.406576 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.wsgi [None req-1c1821da-27f6-4174-8cba-a9e8d1ab72ff tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] HTTP exception thrown: Invalid volume: volume 81dd2a53-4803-4fe5-acc5-aecedf1d2fbc is already attached to instances: 6dabcc62-4829-4f97-830f-e82af447faca Oct 17 03:58:49.408259 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-1c1821da-27f6-4174-8cba-a9e8d1ab72ff tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Request method failure captured: Oct 17 03:58:49.408259 dv-cinder-815582-16-smb devstack@n-api.service[125871]: request: POST /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca/os-volume_attachments HTTP/1.1 Oct 17 03:58:49.408259 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Accept: application/json Oct 17 03:58:49.408259 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Accept-Encoding: identity Oct 17 03:58:49.408259 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Connection: close Oct 17 03:58:49.408259 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Content-Length: 74 Oct 17 03:58:49.408259 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Content-Type: application/json Oct 17 03:58:49.408259 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Host: 10.222.0.16 Oct 17 03:58:49.408259 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Openstack-System-Scope: None Oct 17 03:58:49.408259 dv-cinder-815582-16-smb devstack@n-api.service[125871]: User-Agent: python-urllib3/1.26.12 Oct 17 03:58:49.408259 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Auth-Token: gAAAAABjTNHS-JkBpYGlE8smCEkK5jojHou0K6VK_tNmdNYF8mJS0isG5A2O-CJO1Z0ixcowhaVCDpWbdKHf1nvQBjXwKqEHeDqSudyXAc3IKeNiaKgebnu28MS5PTi1Pi3TKRwLiMEjkJOln2AC5NFbphJ0QfPkQ085FD6azHU6IqdftqedhcI Oct 17 03:58:49.408259 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Domain-Id: None Oct 17 03:58:49.408259 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Domain-Name: None Oct 17 03:58:49.408259 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Identity-Status: Confirmed Oct 17 03:58:49.408259 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Is-Admin-Project: True Oct 17 03:58:49.408259 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Domain-Id: default Oct 17 03:58:49.408259 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Domain-Name: Default Oct 17 03:58:49.408259 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Id: 8af3ce80f169473882a247ba78d3d6ef Oct 17 03:58:49.408259 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Name: tempest-AttachVolumeNegativeTest-973579303 Oct 17 03:58:49.408259 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Role: reader,member Oct 17 03:58:49.408259 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Roles: reader,member Oct 17 03:58:49.410034 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8af3ce80f169473882a247ba78d3d6ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8af3ce80f169473882a247ba78d3d6ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8af3ce80f169473882a247ba78d3d6ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8af3ce80f169473882a247ba78d3d6ef", "adminURL": "http://10.222.0.16:8080"}]}] Oct 17 03:58:49.410034 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant: tempest-AttachVolumeNegativeTest-973579303 Oct 17 03:58:49.410034 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant-Id: 8af3ce80f169473882a247ba78d3d6ef Oct 17 03:58:49.410034 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-973579303 Oct 17 03:58:49.410034 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User: tempest-AttachVolumeNegativeTest-973579303-project Oct 17 03:58:49.410034 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Domain-Id: default Oct 17 03:58:49.410034 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Domain-Name: Default Oct 17 03:58:49.410034 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Id: e9ac14bb6ceb4d9a92a20938e9688bbd Oct 17 03:58:49.410034 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Name: tempest-AttachVolumeNegativeTest-973579303-project Oct 17 03:58:49.410034 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Oct 17 03:58:49.410034 dv-cinder-815582-16-smb devstack@n-api.service[125871]: {"volumeAttachment": {"volumeId": "81dd2a53-4803-4fe5-acc5-aecedf1d2fbc"}} Oct 17 03:58:49.410034 dv-cinder-815582-16-smb devstack@n-api.service[125871]: method: > Oct 17 03:58:49.411116 dv-cinder-815582-16-smb devstack@n-api.service[125871]: exception: Invalid volume: volume 81dd2a53-4803-4fe5-acc5-aecedf1d2fbc is already attached to instances: 6dabcc62-4829-4f97-830f-e82af447faca Oct 17 03:58:49.411116 dv-cinder-815582-16-smb devstack@n-api.service[125871]: action_args: {'server_id': '6dabcc62-4829-4f97-830f-e82af447faca', 'body': {'volumeAttachment': {'volumeId': '81dd2a53-4803-4fe5-acc5-aecedf1d2fbc'}}} Oct 17 03:58:49.411116 dv-cinder-815582-16-smb devstack@n-api.service[125871]: {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:58:49.411116 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:58:49.411116 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 17 03:58:49.411116 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 17 03:58:49.411116 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 03:58:49.411116 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 03:58:49.411116 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 17 03:58:49.411116 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 03:58:49.411116 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 17 03:58:49.411116 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 17 03:58:49.411116 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 17 03:58:49.411116 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 17 03:58:49.411116 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 81dd2a53-4803-4fe5-acc5-aecedf1d2fbc is already attached to instances: 6dabcc62-4829-4f97-830f-e82af447faca Oct 17 03:58:49.411116 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:58:49.411116 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:58:49.411116 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:58:49.411116 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:58:49.412522 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:58:49.412522 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:58:49.412522 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:58:49.412522 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:58:49.412522 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:58:49.412522 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:58:49.412522 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 03:58:49.412522 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 03:58:49.412522 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 03:58:49.412522 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 03:58:49.412522 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 03:58:49.412522 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 03:58:49.412522 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 17 03:58:49.412522 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 17 03:58:49.412522 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 81dd2a53-4803-4fe5-acc5-aecedf1d2fbc is already attached to instances: 6dabcc62-4829-4f97-830f-e82af447faca Oct 17 03:58:49.412522 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:58:49.412522 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:58:49.412522 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:58:49.412522 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:58:49.412522 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:58:49.414376 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:58:49.414376 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:58:49.414376 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:58:49.414376 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 81dd2a53-4803-4fe5-acc5-aecedf1d2fbc is already attached to instances: 6dabcc62-4829-4f97-830f-e82af447faca Oct 17 03:58:49.414376 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:58:49.414376 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-1c1821da-27f6-4174-8cba-a9e8d1ab72ff tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Returning 400 to user: Invalid volume: volume 81dd2a53-4803-4fe5-acc5-aecedf1d2fbc is already attached to instances: 6dabcc62-4829-4f97-830f-e82af447faca {{(pid=125871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:58:49.414376 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-1c1821da-27f6-4174-8cba-a9e8d1ab72ff tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "POST /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.117997 Oct 17 03:58:49.414376 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 385/766] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Oct 17 03:58:49 2022] POST /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca/os-volume_attachments => generated 174 bytes in 119 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 03:58:49.476640 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-46a91061-4756-4eb8-b1f3-241abb2fe703 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:49.477142 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-46a91061-4756-4eb8-b1f3-241abb2fe703 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 6dabcc62-4829-4f97-830f-e82af447faca] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:49.487014 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-46a91061-4756-4eb8-b1f3-241abb2fe703 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:49.487014 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-46a91061-4756-4eb8-b1f3-241abb2fe703 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:49.487014 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-46a91061-4756-4eb8-b1f3-241abb2fe703 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:49.487014 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-46a91061-4756-4eb8-b1f3-241abb2fe703 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:49.487547 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-46a91061-4756-4eb8-b1f3-241abb2fe703 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:49.487547 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-46a91061-4756-4eb8-b1f3-241abb2fe703 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:49.577531 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.objects.instance [None req-46a91061-4756-4eb8-b1f3-241abb2fe703 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lazy-loading 'services' on Instance uuid 6dabcc62-4829-4f97-830f-e82af447faca {{(pid=125872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:58:49.725290 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-af8fff72-2bdf-467e-9aa9-9e37d1d6e3c4 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:49.725906 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-af8fff72-2bdf-467e-9aa9-9e37d1d6e3c4 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 57546995-2ef9-4773-a47a-13cbd2a831a9] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:49.740385 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-af8fff72-2bdf-467e-9aa9-9e37d1d6e3c4 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:49.747368 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-af8fff72-2bdf-467e-9aa9-9e37d1d6e3c4 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:49.747368 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-af8fff72-2bdf-467e-9aa9-9e37d1d6e3c4 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:49.747368 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-af8fff72-2bdf-467e-9aa9-9e37d1d6e3c4 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:49.747368 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-af8fff72-2bdf-467e-9aa9-9e37d1d6e3c4 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:49.747845 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-af8fff72-2bdf-467e-9aa9-9e37d1d6e3c4 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:49.757922 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.wsgi [None req-af8fff72-2bdf-467e-9aa9-9e37d1d6e3c4 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] HTTP exception thrown: Instance 57546995-2ef9-4773-a47a-13cbd2a831a9 could not be found. Oct 17 03:58:49.759489 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-af8fff72-2bdf-467e-9aa9-9e37d1d6e3c4 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Request method failure captured: Oct 17 03:58:49.759489 dv-cinder-815582-16-smb devstack@n-api.service[125871]: request: GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9 HTTP/1.1 Oct 17 03:58:49.759489 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Accept: application/json Oct 17 03:58:49.759489 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Accept-Encoding: identity Oct 17 03:58:49.759489 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Connection: close Oct 17 03:58:49.759489 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Content-Length: 0 Oct 17 03:58:49.759489 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Content-Type: application/json Oct 17 03:58:49.759489 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Host: 10.222.0.16 Oct 17 03:58:49.759489 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Openstack-System-Scope: None Oct 17 03:58:49.759489 dv-cinder-815582-16-smb devstack@n-api.service[125871]: User-Agent: python-urllib3/1.26.12 Oct 17 03:58:49.759489 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Auth-Token: gAAAAABjTNHYLxUsgcq_ACPqiARQRHFZX3xLv8SayCvNAWGNHgFQpkcgEDanwG27BF2rHPhh0X13DIu7TiIER2OGNrGDta7scBiyr4QHstEFtiE-NGtlSlpYsVJP4E4zCTmikL_tTbEERMy_oJ_SGh8iD1-z3BXcak8DQ79G1K_sLtgABtxSp2A Oct 17 03:58:49.759489 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Domain-Id: None Oct 17 03:58:49.759489 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Domain-Name: None Oct 17 03:58:49.759489 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Identity-Status: Confirmed Oct 17 03:58:49.759489 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Is-Admin-Project: True Oct 17 03:58:49.759489 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Domain-Id: default Oct 17 03:58:49.759489 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Domain-Name: Default Oct 17 03:58:49.759489 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Id: b033d35610f34401a99b912f145eb317 Oct 17 03:58:49.759489 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-464495139 Oct 17 03:58:49.759489 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Role: reader,member Oct 17 03:58:49.759489 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Roles: reader,member Oct 17 03:58:49.761062 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b033d35610f34401a99b912f145eb317"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b033d35610f34401a99b912f145eb317"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b033d35610f34401a99b912f145eb317"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b033d35610f34401a99b912f145eb317", "adminURL": "http://10.222.0.16:8080"}]}] Oct 17 03:58:49.761062 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant: tempest-ServerRescueNegativeTestJSON-464495139 Oct 17 03:58:49.761062 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant-Id: b033d35610f34401a99b912f145eb317 Oct 17 03:58:49.761062 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-464495139 Oct 17 03:58:49.761062 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User: tempest-ServerRescueNegativeTestJSON-464495139-project Oct 17 03:58:49.761062 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Domain-Id: default Oct 17 03:58:49.761062 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Domain-Name: Default Oct 17 03:58:49.761062 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Id: fa0a6947667d48bfabf6aefad09c8325 Oct 17 03:58:49.761062 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Name: tempest-ServerRescueNegativeTestJSON-464495139-project Oct 17 03:58:49.761062 dv-cinder-815582-16-smb devstack@n-api.service[125871]: method: > Oct 17 03:58:49.761062 dv-cinder-815582-16-smb devstack@n-api.service[125871]: exception: Instance 57546995-2ef9-4773-a47a-13cbd2a831a9 could not be found. Oct 17 03:58:49.761062 dv-cinder-815582-16-smb devstack@n-api.service[125871]: action_args: {'id': '57546995-2ef9-4773-a47a-13cbd2a831a9'} Oct 17 03:58:49.762688 dv-cinder-815582-16-smb devstack@n-api.service[125871]: {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:58:49.762688 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:58:49.762688 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 03:58:49.762688 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 03:58:49.762688 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 03:58:49.762688 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 03:58:49.762688 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 03:58:49.762688 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 03:58:49.762688 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 03:58:49.762688 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 03:58:49.762688 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57546995-2ef9-4773-a47a-13cbd2a831a9 could not be found. Oct 17 03:58:49.762688 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:58:49.762688 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:58:49.762688 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:58:49.762688 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:58:49.762688 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:58:49.762688 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:58:49.762688 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:58:49.762688 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:58:49.762688 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:58:49.764156 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:58:49.764156 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 03:58:49.764156 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 03:58:49.764156 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 03:58:49.764156 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 03:58:49.764156 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 03:58:49.764156 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:58:49.764156 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57546995-2ef9-4773-a47a-13cbd2a831a9 could not be found. Oct 17 03:58:49.764156 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:58:49.764156 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:58:49.764156 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:58:49.764156 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:58:49.764156 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:58:49.764156 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:58:49.764156 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:58:49.764156 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:58:49.764156 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57546995-2ef9-4773-a47a-13cbd2a831a9 could not be found. Oct 17 03:58:49.764156 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:58:49.765653 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-af8fff72-2bdf-467e-9aa9-9e37d1d6e3c4 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Returning 404 to user: Instance 57546995-2ef9-4773-a47a-13cbd2a831a9 could not be found. {{(pid=125871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:58:49.765653 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-af8fff72-2bdf-467e-9aa9-9e37d1d6e3c4 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9" status: 404 len: 111 microversion: 2.1 time: 0.039529 Oct 17 03:58:49.765653 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 386/767] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:58:49 2022] GET /compute/v2.1/servers/57546995-2ef9-4773-a47a-13cbd2a831a9 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 03:58:49.770467 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-70cab534-308a-4dca-960b-cc62512fb1f6 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '.version_select at 0x7fd72a5261f0>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:49.804431 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-46a91061-4756-4eb8-b1f3-241abb2fe703 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca/os-volume_attachments/81dd2a53-4803-4fe5-acc5-aecedf1d2fbc" status: 202 len: 0 microversion: 2.1 time: 0.332539 Oct 17 03:58:49.809210 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 382/768] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Oct 17 03:58:49 2022] DELETE /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca/os-volume_attachments/81dd2a53-4803-4fe5-acc5-aecedf1d2fbc => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 03:58:49.815339 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-43ead106-3ace-4b3c-9c10-40702278b8d9 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:49.819074 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-43ead106-3ace-4b3c-9c10-40702278b8d9 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 6dabcc62-4829-4f97-830f-e82af447faca] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:49.827946 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-43ead106-3ace-4b3c-9c10-40702278b8d9 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:49.828439 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-43ead106-3ace-4b3c-9c10-40702278b8d9 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:49.828874 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-43ead106-3ace-4b3c-9c10-40702278b8d9 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:49.829629 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-43ead106-3ace-4b3c-9c10-40702278b8d9 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:49.830023 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-43ead106-3ace-4b3c-9c10-40702278b8d9 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:49.830443 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-43ead106-3ace-4b3c-9c10-40702278b8d9 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:49.861881 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-43ead106-3ace-4b3c-9c10-40702278b8d9 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051373 Oct 17 03:58:49.862496 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 383/769] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 17 03:58:49 2022] GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 03:58:49.883196 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-70cab534-308a-4dca-960b-cc62512fb1f6 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1819095120" status: 202 len: 0 microversion: 2.1 time: 0.117142 Oct 17 03:58:49.883851 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 387/770] 10.222.0.16 () {58 vars in 1221 bytes} [Mon Oct 17 03:58:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1819095120 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 03:58:50.787026 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-4aa9ab0f-5c73-440d-abb6-b89d0a30e65b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-192928603", "imageRef": "add1979e-0a3b-4403-a8ae-8d9a7b045fc2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8f7eeeb3-31a1-4493-819a-88b3a1e30f20"}], "security_groups": [{"name": "tempest-securitygroup--286757451"}], "key_name": "tempest-keypair-797351937", "user_data": "}} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:58:50.876317 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-3405c104-f6d2-4b47-9d95-2a6e50c45ef3 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:50.879758 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-3405c104-f6d2-4b47-9d95-2a6e50c45ef3 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 6dabcc62-4829-4f97-830f-e82af447faca] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:50.888370 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3405c104-f6d2-4b47-9d95-2a6e50c45ef3 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:50.889003 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3405c104-f6d2-4b47-9d95-2a6e50c45ef3 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:50.889445 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3405c104-f6d2-4b47-9d95-2a6e50c45ef3 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:50.890420 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3405c104-f6d2-4b47-9d95-2a6e50c45ef3 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:50.891039 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3405c104-f6d2-4b47-9d95-2a6e50c45ef3 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:50.892311 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3405c104-f6d2-4b47-9d95-2a6e50c45ef3 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:50.908162 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.network.neutron [None req-4aa9ab0f-5c73-440d-abb6-b89d0a30e65b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] validate_networks() for [('8f7eeeb3-31a1-4493-819a-88b3a1e30f20', None, None, None, None, None)] {{(pid=125872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 03:58:50.932097 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-3405c104-f6d2-4b47-9d95-2a6e50c45ef3 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061881 Oct 17 03:58:50.935425 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 388/771] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 17 03:58:50 2022] GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 17 03:58:51.107322 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-8b439a6d-f164-4090-b1d2-657f761a6e1c tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:51.107915 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-8b439a6d-f164-4090-b1d2-657f761a6e1c tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 6dabcc62-4829-4f97-830f-e82af447faca] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:51.113837 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8b439a6d-f164-4090-b1d2-657f761a6e1c tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:51.114326 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8b439a6d-f164-4090-b1d2-657f761a6e1c tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:51.114763 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8b439a6d-f164-4090-b1d2-657f761a6e1c tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:51.115486 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8b439a6d-f164-4090-b1d2-657f761a6e1c tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:51.116045 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8b439a6d-f164-4090-b1d2-657f761a6e1c tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:51.116354 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8b439a6d-f164-4090-b1d2-657f761a6e1c tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:51.149029 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-8b439a6d-f164-4090-b1d2-657f761a6e1c tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 6dabcc62-4829-4f97-830f-e82af447faca] Going to try to terminate instance {{(pid=125871) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 03:58:51.306496 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.virt.hardware [None req-4aa9ab0f-5c73-440d-abb6-b89d0a30e65b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Flavor limits 0:0:0 {{(pid=125872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 03:58:51.306918 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.virt.hardware [None req-4aa9ab0f-5c73-440d-abb6-b89d0a30e65b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Image limits 0:0:0 {{(pid=125872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 03:58:51.307429 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.virt.hardware [None req-4aa9ab0f-5c73-440d-abb6-b89d0a30e65b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Flavor pref 0:0:0 {{(pid=125872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 03:58:51.307834 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.virt.hardware [None req-4aa9ab0f-5c73-440d-abb6-b89d0a30e65b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Image pref 0:0:0 {{(pid=125872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 03:58:51.308237 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.virt.hardware [None req-4aa9ab0f-5c73-440d-abb6-b89d0a30e65b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 03:58:51.318023 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-4aa9ab0f-5c73-440d-abb6-b89d0a30e65b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:51.321709 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-4aa9ab0f-5c73-440d-abb6-b89d0a30e65b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:51.321709 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-4aa9ab0f-5c73-440d-abb6-b89d0a30e65b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:51.321709 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-4aa9ab0f-5c73-440d-abb6-b89d0a30e65b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:51.321709 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-4aa9ab0f-5c73-440d-abb6-b89d0a30e65b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:51.322037 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-4aa9ab0f-5c73-440d-abb6-b89d0a30e65b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:51.337486 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.quota [None req-4aa9ab0f-5c73-440d-abb6-b89d0a30e65b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Getting quotas for project 2301e8558e0148a481982b776c91e839. Resources: {'cores', 'instances', 'ram'} {{(pid=125872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 03:58:51.343608 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.quota [None req-4aa9ab0f-5c73-440d-abb6-b89d0a30e65b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Getting quotas for user 67fe62eeb9d043a59baa93def8d43265 and project 2301e8558e0148a481982b776c91e839. Resources: {'cores', 'instances', 'ram'} {{(pid=125872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 03:58:51.358099 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-4aa9ab0f-5c73-440d-abb6-b89d0a30e65b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Going to run 1 instances... {{(pid=125872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 03:58:51.362078 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-4aa9ab0f-5c73-440d-abb6-b89d0a30e65b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='add1979e-0a3b-4403-a8ae-8d9a7b045fc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 03:58:51.423867 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-8b439a6d-f164-4090-b1d2-657f761a6e1c tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca" status: 204 len: 0 microversion: 2.1 time: 0.320711 Oct 17 03:58:51.424459 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 389/772] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 17 03:58:51 2022] DELETE /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 03:58:51.432891 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-cf48ef3a-66c2-4217-b230-25cbf3b4eb06 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:51.433601 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-cf48ef3a-66c2-4217-b230-25cbf3b4eb06 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 6dabcc62-4829-4f97-830f-e82af447faca] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:51.439512 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-cf48ef3a-66c2-4217-b230-25cbf3b4eb06 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:51.440000 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-cf48ef3a-66c2-4217-b230-25cbf3b4eb06 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:51.440440 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-cf48ef3a-66c2-4217-b230-25cbf3b4eb06 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:51.441133 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-cf48ef3a-66c2-4217-b230-25cbf3b4eb06 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:51.441591 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-cf48ef3a-66c2-4217-b230-25cbf3b4eb06 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:51.442022 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-cf48ef3a-66c2-4217-b230-25cbf3b4eb06 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:51.480971 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-4aa9ab0f-5c73-440d-abb6-b89d0a30e65b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.693418 Oct 17 03:58:51.485018 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 384/773] 10.222.0.16 () {62 vars in 1188 bytes} [Mon Oct 17 03:58:50 2022] POST /compute/v2.1/servers => generated 401 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 17 03:58:51.494723 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-7f5ef93d-a5ec-46e0-a026-d01bcb323f3b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:51.495360 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-7f5ef93d-a5ec-46e0-a026-d01bcb323f3b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:51.572122 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-7f5ef93d-a5ec-46e0-a026-d01bcb323f3b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:51.582296 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-7f5ef93d-a5ec-46e0-a026-d01bcb323f3b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:51.583885 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-7f5ef93d-a5ec-46e0-a026-d01bcb323f3b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:51.585188 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-7f5ef93d-a5ec-46e0-a026-d01bcb323f3b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6" status: 200 len: 1280 microversion: 2.20 time: 0.094691 Oct 17 03:58:51.586315 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 385/774] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:58:51 2022] GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6 => generated 1280 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:58:51.617731 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-cf48ef3a-66c2-4217-b230-25cbf3b4eb06 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:51.628011 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-cf48ef3a-66c2-4217-b230-25cbf3b4eb06 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca" status: 200 len: 1681 microversion: 2.1 time: 0.198421 Oct 17 03:58:51.628944 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 390/775] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:58:51 2022] GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca => generated 1681 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:58:52.612115 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-a9badc3f-0d96-4c15-a214-7e6b58b98d7f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:52.612829 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-a9badc3f-0d96-4c15-a214-7e6b58b98d7f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:52.619731 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a9badc3f-0d96-4c15-a214-7e6b58b98d7f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:52.620220 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a9badc3f-0d96-4c15-a214-7e6b58b98d7f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:52.620663 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a9badc3f-0d96-4c15-a214-7e6b58b98d7f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:52.621908 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a9badc3f-0d96-4c15-a214-7e6b58b98d7f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:52.622366 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a9badc3f-0d96-4c15-a214-7e6b58b98d7f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:52.622808 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a9badc3f-0d96-4c15-a214-7e6b58b98d7f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:52.639616 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:58:52.652930 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-30adaa23-2bfa-4bb1-bdb5-7ae485023b89 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:52.654055 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-30adaa23-2bfa-4bb1-bdb5-7ae485023b89 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 6dabcc62-4829-4f97-830f-e82af447faca] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:52.661738 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-30adaa23-2bfa-4bb1-bdb5-7ae485023b89 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:52.662473 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-30adaa23-2bfa-4bb1-bdb5-7ae485023b89 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:52.662980 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-30adaa23-2bfa-4bb1-bdb5-7ae485023b89 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:52.664486 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-30adaa23-2bfa-4bb1-bdb5-7ae485023b89 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:52.665852 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-30adaa23-2bfa-4bb1-bdb5-7ae485023b89 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:52.666622 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-30adaa23-2bfa-4bb1-bdb5-7ae485023b89 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:52.690463 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-a9badc3f-0d96-4c15-a214-7e6b58b98d7f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:52.698621 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-a9badc3f-0d96-4c15-a214-7e6b58b98d7f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:52.700694 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-a9badc3f-0d96-4c15-a214-7e6b58b98d7f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:52.701815 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-a9badc3f-0d96-4c15-a214-7e6b58b98d7f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6" status: 200 len: 1284 microversion: 2.20 time: 0.093643 Oct 17 03:58:52.702572 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 386/776] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:58:52 2022] GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6 => generated 1284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:58:52.812321 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-30adaa23-2bfa-4bb1-bdb5-7ae485023b89 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:52.819960 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-30adaa23-2bfa-4bb1-bdb5-7ae485023b89 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca" status: 200 len: 1681 microversion: 2.1 time: 0.171286 Oct 17 03:58:52.820529 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 391/777] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:58:52 2022] GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:58:53.477012 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-2d618af4-2b90-40e3-8dfe-93999f452f75 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:53.477596 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-2d618af4-2b90-40e3-8dfe-93999f452f75 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 15a2e41f-4480-429c-9207-8d95daa186f5] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:53.485306 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2d618af4-2b90-40e3-8dfe-93999f452f75 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:53.485959 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2d618af4-2b90-40e3-8dfe-93999f452f75 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:53.486443 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2d618af4-2b90-40e3-8dfe-93999f452f75 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:53.487256 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2d618af4-2b90-40e3-8dfe-93999f452f75 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:53.487824 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2d618af4-2b90-40e3-8dfe-93999f452f75 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:53.488329 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2d618af4-2b90-40e3-8dfe-93999f452f75 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:53.514488 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-2d618af4-2b90-40e3-8dfe-93999f452f75 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 15a2e41f-4480-429c-9207-8d95daa186f5] Going to try to terminate instance {{(pid=125872) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 03:58:53.726000 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-8d6e89f2-8ca4-4e20-986c-29da2f954ad3 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:53.727164 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-8d6e89f2-8ca4-4e20-986c-29da2f954ad3 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:53.732405 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:58:53.735146 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8d6e89f2-8ca4-4e20-986c-29da2f954ad3 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:53.735892 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8d6e89f2-8ca4-4e20-986c-29da2f954ad3 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:53.736498 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8d6e89f2-8ca4-4e20-986c-29da2f954ad3 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:53.737379 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8d6e89f2-8ca4-4e20-986c-29da2f954ad3 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:53.738003 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8d6e89f2-8ca4-4e20-986c-29da2f954ad3 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:53.738632 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8d6e89f2-8ca4-4e20-986c-29da2f954ad3 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:53.845057 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-2d618af4-2b90-40e3-8dfe-93999f452f75 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "DELETE /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5" status: 204 len: 0 microversion: 2.1 time: 0.372653 Oct 17 03:58:53.845678 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 387/778] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 17 03:58:53 2022] DELETE /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 03:58:53.851259 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-fef24a51-4b47-4d0f-9f75-0a22b79fe8de tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:53.851984 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-fef24a51-4b47-4d0f-9f75-0a22b79fe8de tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 6dabcc62-4829-4f97-830f-e82af447faca] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:53.858276 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-fef24a51-4b47-4d0f-9f75-0a22b79fe8de tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:53.858765 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-fef24a51-4b47-4d0f-9f75-0a22b79fe8de tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:53.859772 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-fef24a51-4b47-4d0f-9f75-0a22b79fe8de tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:53.859897 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-fef24a51-4b47-4d0f-9f75-0a22b79fe8de tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:53.860346 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-fef24a51-4b47-4d0f-9f75-0a22b79fe8de tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:53.860762 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-fef24a51-4b47-4d0f-9f75-0a22b79fe8de tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:53.942723 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-fef24a51-4b47-4d0f-9f75-0a22b79fe8de tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:53.961173 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-fef24a51-4b47-4d0f-9f75-0a22b79fe8de tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca" status: 200 len: 1614 microversion: 2.1 time: 0.112698 Oct 17 03:58:53.981322 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 388/779] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:58:53 2022] GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca => generated 1614 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:58:53.981322 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-6056ab37-e930-4152-a00b-b2cff095217c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:53.981322 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-6056ab37-e930-4152-a00b-b2cff095217c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 15a2e41f-4480-429c-9207-8d95daa186f5] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:53.990517 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6056ab37-e930-4152-a00b-b2cff095217c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:53.991014 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6056ab37-e930-4152-a00b-b2cff095217c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:53.991480 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6056ab37-e930-4152-a00b-b2cff095217c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:53.992190 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6056ab37-e930-4152-a00b-b2cff095217c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:53.992648 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6056ab37-e930-4152-a00b-b2cff095217c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:53.999082 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6056ab37-e930-4152-a00b-b2cff095217c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:54.044736 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-8d6e89f2-8ca4-4e20-986c-29da2f954ad3 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:54.052739 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-8d6e89f2-8ca4-4e20-986c-29da2f954ad3 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:54.054591 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-8d6e89f2-8ca4-4e20-986c-29da2f954ad3 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:54.056086 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-8d6e89f2-8ca4-4e20-986c-29da2f954ad3 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6" status: 200 len: 1332 microversion: 2.20 time: 0.334065 Oct 17 03:58:54.056856 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 392/780] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:58:53 2022] GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6 => generated 1332 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:58:54.186563 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-6056ab37-e930-4152-a00b-b2cff095217c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:54.203737 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-6056ab37-e930-4152-a00b-b2cff095217c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5" status: 200 len: 1507 microversion: 2.1 time: 0.239570 Oct 17 03:58:54.221295 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 389/781] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:58:53 2022] GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5 => generated 1507 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:58:54.334237 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [req-d826462d-1523-4ca7-b654-34dd5461dd5e req-f6dd1b6b-e15c-4cda-86d3-bd2a2bb69122 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dabcc62-4829-4f97-830f-e82af447faca", "name": "network-vif-deleted", "tag": "75567cd8-4940-4ce0-8d82-997c7cc06bc0"}]} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:58:54.344354 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-d826462d-1523-4ca7-b654-34dd5461dd5e req-f6dd1b6b-e15c-4cda-86d3-bd2a2bb69122 service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:54.344838 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-d826462d-1523-4ca7-b654-34dd5461dd5e req-f6dd1b6b-e15c-4cda-86d3-bd2a2bb69122 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:54.345272 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-d826462d-1523-4ca7-b654-34dd5461dd5e req-f6dd1b6b-e15c-4cda-86d3-bd2a2bb69122 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:54.357303 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.compute.server_external_events [req-d826462d-1523-4ca7-b654-34dd5461dd5e req-f6dd1b6b-e15c-4cda-86d3-bd2a2bb69122 service nova] Creating event network-vif-deleted:75567cd8-4940-4ce0-8d82-997c7cc06bc0 for instance 6dabcc62-4829-4f97-830f-e82af447faca on hv-cinder-81558 Oct 17 03:58:54.362296 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [req-d826462d-1523-4ca7-b654-34dd5461dd5e req-f6dd1b6b-e15c-4cda-86d3-bd2a2bb69122 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031738 Oct 17 03:58:54.362922 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 393/782] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 03:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:58:54.992878 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-fa8653b5-d226-4095-8e8d-6673a07683b3 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:54.993682 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-fa8653b5-d226-4095-8e8d-6673a07683b3 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 6dabcc62-4829-4f97-830f-e82af447faca] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:55.002151 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-fa8653b5-d226-4095-8e8d-6673a07683b3 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:55.002715 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-fa8653b5-d226-4095-8e8d-6673a07683b3 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:55.003137 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-fa8653b5-d226-4095-8e8d-6673a07683b3 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:55.004244 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-fa8653b5-d226-4095-8e8d-6673a07683b3 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:55.004873 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-fa8653b5-d226-4095-8e8d-6673a07683b3 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:55.005423 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-fa8653b5-d226-4095-8e8d-6673a07683b3 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:55.073400 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-fa8653b5-d226-4095-8e8d-6673a07683b3 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:55.085624 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-fa8653b5-d226-4095-8e8d-6673a07683b3 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca" status: 200 len: 1614 microversion: 2.1 time: 0.095808 Oct 17 03:58:55.085624 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 390/783] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:58:54 2022] GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca => generated 1614 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:58:55.092874 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-dc4ea98e-d25e-4334-baf3-12af340a65f1 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:55.093755 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-dc4ea98e-d25e-4334-baf3-12af340a65f1 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:55.100646 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-dc4ea98e-d25e-4334-baf3-12af340a65f1 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:55.101282 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-dc4ea98e-d25e-4334-baf3-12af340a65f1 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:55.101827 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-dc4ea98e-d25e-4334-baf3-12af340a65f1 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:55.102824 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-dc4ea98e-d25e-4334-baf3-12af340a65f1 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:55.103428 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-dc4ea98e-d25e-4334-baf3-12af340a65f1 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:55.103954 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-dc4ea98e-d25e-4334-baf3-12af340a65f1 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:55.172479 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-dc4ea98e-d25e-4334-baf3-12af340a65f1 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:55.182557 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-dc4ea98e-d25e-4334-baf3-12af340a65f1 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:55.184392 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-dc4ea98e-d25e-4334-baf3-12af340a65f1 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:55.185523 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-dc4ea98e-d25e-4334-baf3-12af340a65f1 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6" status: 200 len: 1340 microversion: 2.20 time: 0.103159 Oct 17 03:58:55.186601 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 394/784] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:58:55 2022] GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6 => generated 1340 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:58:55.229038 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-f4c6608e-dbb8-45c3-8e0a-592b64735b83 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:55.229688 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-f4c6608e-dbb8-45c3-8e0a-592b64735b83 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 15a2e41f-4480-429c-9207-8d95daa186f5] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:55.238947 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f4c6608e-dbb8-45c3-8e0a-592b64735b83 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:55.238947 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f4c6608e-dbb8-45c3-8e0a-592b64735b83 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:55.238947 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f4c6608e-dbb8-45c3-8e0a-592b64735b83 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:55.238947 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f4c6608e-dbb8-45c3-8e0a-592b64735b83 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:55.239348 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f4c6608e-dbb8-45c3-8e0a-592b64735b83 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:55.239348 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f4c6608e-dbb8-45c3-8e0a-592b64735b83 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:55.384909 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-f4c6608e-dbb8-45c3-8e0a-592b64735b83 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:55.394388 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-f4c6608e-dbb8-45c3-8e0a-592b64735b83 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5" status: 200 len: 1507 microversion: 2.1 time: 0.169159 Oct 17 03:58:55.394998 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 391/785] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:58:55 2022] GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5 => generated 1507 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:58:55.892178 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-c38741ea-aa95-4540-bce5-b7dfcd40d18b tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:58:55.892718 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-c38741ea-aa95-4540-bce5-b7dfcd40d18b tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] [instance: d471c80c-12be-4e18-89d6-d64601602d39] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:55.898722 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c38741ea-aa95-4540-bce5-b7dfcd40d18b tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:55.899239 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c38741ea-aa95-4540-bce5-b7dfcd40d18b tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:55.899679 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c38741ea-aa95-4540-bce5-b7dfcd40d18b tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:55.900369 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c38741ea-aa95-4540-bce5-b7dfcd40d18b tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:55.900828 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c38741ea-aa95-4540-bce5-b7dfcd40d18b tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:55.901256 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c38741ea-aa95-4540-bce5-b7dfcd40d18b tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:55.923869 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.objects.instance [None req-c38741ea-aa95-4540-bce5-b7dfcd40d18b tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lazy-loading 'flavor' on Instance uuid d471c80c-12be-4e18-89d6-d64601602d39 {{(pid=125871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:58:56.170810 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-cd760666-f328-4e5f-a068-ea1e8b972c2a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:56.171464 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-cd760666-f328-4e5f-a068-ea1e8b972c2a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 6dabcc62-4829-4f97-830f-e82af447faca] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:56.177565 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-cd760666-f328-4e5f-a068-ea1e8b972c2a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:56.178053 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-cd760666-f328-4e5f-a068-ea1e8b972c2a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:56.178468 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-cd760666-f328-4e5f-a068-ea1e8b972c2a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:56.179147 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-cd760666-f328-4e5f-a068-ea1e8b972c2a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:56.179614 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-cd760666-f328-4e5f-a068-ea1e8b972c2a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:56.180033 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-cd760666-f328-4e5f-a068-ea1e8b972c2a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:56.194127 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-c38741ea-aa95-4540-bce5-b7dfcd40d18b tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] 10.222.0.16 "POST /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39/action" status: 202 len: 0 microversion: 2.1 time: 0.306413 Oct 17 03:58:56.198258 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 395/786] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 17 03:58:55 2022] POST /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 03:58:56.205401 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-d17462f0-a81e-4bc8-8963-de542db7fe0c tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:56.206267 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-d17462f0-a81e-4bc8-8963-de542db7fe0c tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] [instance: d471c80c-12be-4e18-89d6-d64601602d39] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:56.212586 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d17462f0-a81e-4bc8-8963-de542db7fe0c tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:56.213075 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d17462f0-a81e-4bc8-8963-de542db7fe0c tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:56.213545 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d17462f0-a81e-4bc8-8963-de542db7fe0c tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:56.214661 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d17462f0-a81e-4bc8-8963-de542db7fe0c tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:56.215074 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d17462f0-a81e-4bc8-8963-de542db7fe0c tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:56.216190 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d17462f0-a81e-4bc8-8963-de542db7fe0c tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:56.253923 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-cd760666-f328-4e5f-a068-ea1e8b972c2a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:56.263932 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-cd760666-f328-4e5f-a068-ea1e8b972c2a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca" status: 200 len: 1327 microversion: 2.1 time: 0.160056 Oct 17 03:58:56.264712 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 392/787] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:58:56 2022] GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca => generated 1327 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:58:56.269496 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-968187a7-edfa-4edb-bd35-65b66a43dacd tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:56.270815 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-968187a7-edfa-4edb-bd35-65b66a43dacd tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:56.276720 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-968187a7-edfa-4edb-bd35-65b66a43dacd tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:56.277214 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-968187a7-edfa-4edb-bd35-65b66a43dacd tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:56.277704 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-968187a7-edfa-4edb-bd35-65b66a43dacd tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:56.278960 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-968187a7-edfa-4edb-bd35-65b66a43dacd tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:56.278960 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-968187a7-edfa-4edb-bd35-65b66a43dacd tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:56.279349 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-968187a7-edfa-4edb-bd35-65b66a43dacd tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:56.359031 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-968187a7-edfa-4edb-bd35-65b66a43dacd tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:56.364180 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-968187a7-edfa-4edb-bd35-65b66a43dacd tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:56.365641 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-968187a7-edfa-4edb-bd35-65b66a43dacd tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:56.366869 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-968187a7-edfa-4edb-bd35-65b66a43dacd tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6" status: 200 len: 1340 microversion: 2.20 time: 0.101308 Oct 17 03:58:56.367756 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 393/788] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:58:56 2022] GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6 => generated 1340 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:58:56.418675 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-03bae898-daaa-45cf-8c80-4312b6519f8a tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:56.419588 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-03bae898-daaa-45cf-8c80-4312b6519f8a tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 15a2e41f-4480-429c-9207-8d95daa186f5] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:56.425781 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-03bae898-daaa-45cf-8c80-4312b6519f8a tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:56.426286 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-03bae898-daaa-45cf-8c80-4312b6519f8a tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:56.426726 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-03bae898-daaa-45cf-8c80-4312b6519f8a tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:56.427524 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-03bae898-daaa-45cf-8c80-4312b6519f8a tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:56.427988 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-03bae898-daaa-45cf-8c80-4312b6519f8a tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:56.428421 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-03bae898-daaa-45cf-8c80-4312b6519f8a tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:56.430105 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-d17462f0-a81e-4bc8-8963-de542db7fe0c tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b22f27c7144a3d96f41747473fe646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0a418ceb742fdb01c98c5d58424a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:56.443633 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-d17462f0-a81e-4bc8-8963-de542db7fe0c tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] 10.222.0.16 "GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39" status: 200 len: 1566 microversion: 2.1 time: 0.243842 Oct 17 03:58:56.444962 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 396/789] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:58:56 2022] GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39 => generated 1566 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:58:56.685050 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-03bae898-daaa-45cf-8c80-4312b6519f8a tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:56.695259 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-03bae898-daaa-45cf-8c80-4312b6519f8a tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5" status: 200 len: 1507 microversion: 2.1 time: 0.280303 Oct 17 03:58:56.697445 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 394/790] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:58:56 2022] GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5 => generated 1507 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:58:57.028581 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [req-392c0153-7cbe-4d0b-a23f-5b1d155e2cba req-c66c3a3c-bcf5-44c6-aa65-eb5c1aa67f10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15a2e41f-4480-429c-9207-8d95daa186f5", "name": "network-vif-deleted", "tag": "d40b4ca9-61e5-4ad3-89cf-f8e01e08a864"}]} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:58:57.038166 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-392c0153-7cbe-4d0b-a23f-5b1d155e2cba req-c66c3a3c-bcf5-44c6-aa65-eb5c1aa67f10 service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:57.038645 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-392c0153-7cbe-4d0b-a23f-5b1d155e2cba req-c66c3a3c-bcf5-44c6-aa65-eb5c1aa67f10 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:57.039073 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-392c0153-7cbe-4d0b-a23f-5b1d155e2cba req-c66c3a3c-bcf5-44c6-aa65-eb5c1aa67f10 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:57.050817 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.compute.server_external_events [req-392c0153-7cbe-4d0b-a23f-5b1d155e2cba req-c66c3a3c-bcf5-44c6-aa65-eb5c1aa67f10 service nova] Creating event network-vif-deleted:d40b4ca9-61e5-4ad3-89cf-f8e01e08a864 for instance 15a2e41f-4480-429c-9207-8d95daa186f5 on hv-cinder-81558 Oct 17 03:58:57.055932 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [req-392c0153-7cbe-4d0b-a23f-5b1d155e2cba req-c66c3a3c-bcf5-44c6-aa65-eb5c1aa67f10 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031636 Oct 17 03:58:57.056530 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 397/791] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 03:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:58:57.295586 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-f64a1436-9f23-4f10-af48-2ee204f59d8e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:57.296178 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-f64a1436-9f23-4f10-af48-2ee204f59d8e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 6dabcc62-4829-4f97-830f-e82af447faca] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:57.308751 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f64a1436-9f23-4f10-af48-2ee204f59d8e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:57.309482 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f64a1436-9f23-4f10-af48-2ee204f59d8e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:57.310087 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f64a1436-9f23-4f10-af48-2ee204f59d8e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:57.312546 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f64a1436-9f23-4f10-af48-2ee204f59d8e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:57.313591 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f64a1436-9f23-4f10-af48-2ee204f59d8e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:57.314171 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f64a1436-9f23-4f10-af48-2ee204f59d8e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:57.371241 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f64a1436-9f23-4f10-af48-2ee204f59d8e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:57.372207 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f64a1436-9f23-4f10-af48-2ee204f59d8e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:57.372791 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f64a1436-9f23-4f10-af48-2ee204f59d8e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:57.373384 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.objects.instance [None req-f64a1436-9f23-4f10-af48-2ee204f59d8e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lazy-loading 'fault' on Instance uuid 6dabcc62-4829-4f97-830f-e82af447faca {{(pid=125872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:58:57.394699 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-0206f91b-6397-4f52-a150-d4158fb02ffd tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:57.395551 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-0206f91b-6397-4f52-a150-d4158fb02ffd tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:57.406393 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0206f91b-6397-4f52-a150-d4158fb02ffd tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:57.419646 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0206f91b-6397-4f52-a150-d4158fb02ffd tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:57.423762 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0206f91b-6397-4f52-a150-d4158fb02ffd tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:57.426141 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0206f91b-6397-4f52-a150-d4158fb02ffd tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:57.429454 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0206f91b-6397-4f52-a150-d4158fb02ffd tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:57.430253 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0206f91b-6397-4f52-a150-d4158fb02ffd tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:57.484120 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-f64a1436-9f23-4f10-af48-2ee204f59d8e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:57.494178 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-f64a1436-9f23-4f10-af48-2ee204f59d8e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca" status: 200 len: 1332 microversion: 2.1 time: 0.204652 Oct 17 03:58:57.495507 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 395/792] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:58:57 2022] GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca => generated 1332 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:58:57.501047 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-16b43ef7-5da9-4ea3-8fc6-a54e1425c8fe tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:57.502153 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-16b43ef7-5da9-4ea3-8fc6-a54e1425c8fe tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] [instance: d471c80c-12be-4e18-89d6-d64601602d39] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:57.509033 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-16b43ef7-5da9-4ea3-8fc6-a54e1425c8fe tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:57.509803 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-16b43ef7-5da9-4ea3-8fc6-a54e1425c8fe tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:57.510375 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-16b43ef7-5da9-4ea3-8fc6-a54e1425c8fe tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:57.511402 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-16b43ef7-5da9-4ea3-8fc6-a54e1425c8fe tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:57.513095 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-16b43ef7-5da9-4ea3-8fc6-a54e1425c8fe tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:57.513739 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-16b43ef7-5da9-4ea3-8fc6-a54e1425c8fe tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:57.662458 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-16b43ef7-5da9-4ea3-8fc6-a54e1425c8fe tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b22f27c7144a3d96f41747473fe646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0a418ceb742fdb01c98c5d58424a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:57.672041 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-16b43ef7-5da9-4ea3-8fc6-a54e1425c8fe tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] 10.222.0.16 "GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39" status: 200 len: 1566 microversion: 2.1 time: 0.175359 Oct 17 03:58:57.673172 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 396/793] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:58:57 2022] GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39 => generated 1566 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:58:57.720188 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-569a8eaf-dfc8-4362-9359-f42d1d14858f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:57.720979 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-569a8eaf-dfc8-4362-9359-f42d1d14858f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 15a2e41f-4480-429c-9207-8d95daa186f5] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:57.727350 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-569a8eaf-dfc8-4362-9359-f42d1d14858f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:57.728043 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-569a8eaf-dfc8-4362-9359-f42d1d14858f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:57.728470 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-569a8eaf-dfc8-4362-9359-f42d1d14858f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:57.728681 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-0206f91b-6397-4f52-a150-d4158fb02ffd tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:57.729161 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-569a8eaf-dfc8-4362-9359-f42d1d14858f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:57.729612 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-569a8eaf-dfc8-4362-9359-f42d1d14858f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:57.730029 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-569a8eaf-dfc8-4362-9359-f42d1d14858f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:57.745677 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-0206f91b-6397-4f52-a150-d4158fb02ffd tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:57.745677 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-0206f91b-6397-4f52-a150-d4158fb02ffd tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:57.746014 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-0206f91b-6397-4f52-a150-d4158fb02ffd tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6" status: 200 len: 1405 microversion: 2.20 time: 0.355216 Oct 17 03:58:57.751522 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 398/794] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:58:57 2022] GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6 => generated 1405 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:58:57.776964 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-569a8eaf-dfc8-4362-9359-f42d1d14858f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:57.777453 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-569a8eaf-dfc8-4362-9359-f42d1d14858f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:57.777913 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-569a8eaf-dfc8-4362-9359-f42d1d14858f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:57.778356 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.objects.instance [None req-569a8eaf-dfc8-4362-9359-f42d1d14858f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lazy-loading 'fault' on Instance uuid 15a2e41f-4480-429c-9207-8d95daa186f5 {{(pid=125872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:58:57.830754 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-569a8eaf-dfc8-4362-9359-f42d1d14858f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:57.838385 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-569a8eaf-dfc8-4362-9359-f42d1d14858f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5" status: 200 len: 1312 microversion: 2.1 time: 0.123169 Oct 17 03:58:57.838959 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 397/795] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:58:57 2022] GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5 => generated 1312 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:58:58.372215 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [req-7e84ecfd-f07e-4e3f-9b6c-0b0dadb9e013 req-6c63962b-a1c9-4cd8-bd1a-f67ccc79d8ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5d69048-2557-4e13-92de-3381030814e6", "tag": "4983815b-2774-4cc1-a815-084c70865641"}]} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:58:58.380830 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_cell0:SELECT=4 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:58:58.383196 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-7e84ecfd-f07e-4e3f-9b6c-0b0dadb9e013 req-6c63962b-a1c9-4cd8-bd1a-f67ccc79d8ab service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:58.383689 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-7e84ecfd-f07e-4e3f-9b6c-0b0dadb9e013 req-6c63962b-a1c9-4cd8-bd1a-f67ccc79d8ab service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:58.384120 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-7e84ecfd-f07e-4e3f-9b6c-0b0dadb9e013 req-6c63962b-a1c9-4cd8-bd1a-f67ccc79d8ab service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:58.396255 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.compute.server_external_events [req-7e84ecfd-f07e-4e3f-9b6c-0b0dadb9e013 req-6c63962b-a1c9-4cd8-bd1a-f67ccc79d8ab service nova] Creating event network-changed:4983815b-2774-4cc1-a815-084c70865641 for instance e5d69048-2557-4e13-92de-3381030814e6 on hv-cinder-81558 Oct 17 03:58:58.401330 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [req-7e84ecfd-f07e-4e3f-9b6c-0b0dadb9e013 req-6c63962b-a1c9-4cd8-bd1a-f67ccc79d8ab service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033576 Oct 17 03:58:58.402144 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 399/796] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 03:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 03:58:58.517732 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-9a748fea-2bc5-4e92-91c0-eb5c9d165bdc tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:58.518344 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-9a748fea-2bc5-4e92-91c0-eb5c9d165bdc tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 6dabcc62-4829-4f97-830f-e82af447faca] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:58.524791 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-9a748fea-2bc5-4e92-91c0-eb5c9d165bdc tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:58.525298 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-9a748fea-2bc5-4e92-91c0-eb5c9d165bdc tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:58.525728 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-9a748fea-2bc5-4e92-91c0-eb5c9d165bdc tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:58.526601 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-9a748fea-2bc5-4e92-91c0-eb5c9d165bdc tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:58.527114 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-9a748fea-2bc5-4e92-91c0-eb5c9d165bdc tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:58.528066 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-9a748fea-2bc5-4e92-91c0-eb5c9d165bdc tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:58.541428 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.wsgi [None req-9a748fea-2bc5-4e92-91c0-eb5c9d165bdc tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] HTTP exception thrown: Instance 6dabcc62-4829-4f97-830f-e82af447faca could not be found. Oct 17 03:58:58.543067 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-9a748fea-2bc5-4e92-91c0-eb5c9d165bdc tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Request method failure captured: Oct 17 03:58:58.543067 dv-cinder-815582-16-smb devstack@n-api.service[125872]: request: GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca HTTP/1.1 Oct 17 03:58:58.543067 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Accept: application/json Oct 17 03:58:58.543067 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Accept-Encoding: identity Oct 17 03:58:58.543067 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Connection: close Oct 17 03:58:58.543067 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Content-Length: 0 Oct 17 03:58:58.543067 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Content-Type: application/json Oct 17 03:58:58.543067 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Host: 10.222.0.16 Oct 17 03:58:58.543067 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Openstack-System-Scope: None Oct 17 03:58:58.543067 dv-cinder-815582-16-smb devstack@n-api.service[125872]: User-Agent: python-urllib3/1.26.12 Oct 17 03:58:58.543067 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Auth-Token: gAAAAABjTNHS-JkBpYGlE8smCEkK5jojHou0K6VK_tNmdNYF8mJS0isG5A2O-CJO1Z0ixcowhaVCDpWbdKHf1nvQBjXwKqEHeDqSudyXAc3IKeNiaKgebnu28MS5PTi1Pi3TKRwLiMEjkJOln2AC5NFbphJ0QfPkQ085FD6azHU6IqdftqedhcI Oct 17 03:58:58.543067 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Domain-Id: None Oct 17 03:58:58.543067 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Domain-Name: None Oct 17 03:58:58.543067 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Identity-Status: Confirmed Oct 17 03:58:58.543067 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Is-Admin-Project: True Oct 17 03:58:58.543067 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Domain-Id: default Oct 17 03:58:58.543067 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Domain-Name: Default Oct 17 03:58:58.543067 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Id: 8af3ce80f169473882a247ba78d3d6ef Oct 17 03:58:58.543067 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Name: tempest-AttachVolumeNegativeTest-973579303 Oct 17 03:58:58.543067 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Role: reader,member Oct 17 03:58:58.543067 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Roles: reader,member Oct 17 03:58:58.545087 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8af3ce80f169473882a247ba78d3d6ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8af3ce80f169473882a247ba78d3d6ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8af3ce80f169473882a247ba78d3d6ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8af3ce80f169473882a247ba78d3d6ef", "adminURL": "http://10.222.0.16:8080"}]}] Oct 17 03:58:58.545087 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant: tempest-AttachVolumeNegativeTest-973579303 Oct 17 03:58:58.545087 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant-Id: 8af3ce80f169473882a247ba78d3d6ef Oct 17 03:58:58.545087 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-973579303 Oct 17 03:58:58.545087 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User: tempest-AttachVolumeNegativeTest-973579303-project Oct 17 03:58:58.545087 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Domain-Id: default Oct 17 03:58:58.545087 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Domain-Name: Default Oct 17 03:58:58.545087 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Id: e9ac14bb6ceb4d9a92a20938e9688bbd Oct 17 03:58:58.545087 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Name: tempest-AttachVolumeNegativeTest-973579303-project Oct 17 03:58:58.545087 dv-cinder-815582-16-smb devstack@n-api.service[125872]: method: > Oct 17 03:58:58.545087 dv-cinder-815582-16-smb devstack@n-api.service[125872]: exception: Instance 6dabcc62-4829-4f97-830f-e82af447faca could not be found. Oct 17 03:58:58.545087 dv-cinder-815582-16-smb devstack@n-api.service[125872]: action_args: {'id': '6dabcc62-4829-4f97-830f-e82af447faca'} Oct 17 03:58:58.546099 dv-cinder-815582-16-smb devstack@n-api.service[125872]: {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:58:58.546099 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:58:58.546099 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 03:58:58.546099 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 03:58:58.546099 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 03:58:58.546099 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 03:58:58.546099 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 03:58:58.546099 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 03:58:58.546099 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 03:58:58.546099 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 03:58:58.546099 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dabcc62-4829-4f97-830f-e82af447faca could not be found. Oct 17 03:58:58.546099 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:58:58.546099 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:58:58.546099 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:58:58.546099 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:58:58.546099 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:58:58.546099 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:58:58.546099 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:58:58.546099 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:58:58.546099 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:58:58.548046 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:58:58.548046 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 03:58:58.548046 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 03:58:58.548046 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 03:58:58.548046 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 03:58:58.548046 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 03:58:58.548046 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:58:58.548046 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dabcc62-4829-4f97-830f-e82af447faca could not be found. Oct 17 03:58:58.548046 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:58:58.548046 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:58:58.548046 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:58:58.548046 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:58:58.548046 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:58:58.548046 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:58:58.548046 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:58:58.548046 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:58:58.548046 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dabcc62-4829-4f97-830f-e82af447faca could not be found. Oct 17 03:58:58.548046 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:58:58.550491 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-9a748fea-2bc5-4e92-91c0-eb5c9d165bdc tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Returning 404 to user: Instance 6dabcc62-4829-4f97-830f-e82af447faca could not be found. {{(pid=125872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:58:58.550491 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-9a748fea-2bc5-4e92-91c0-eb5c9d165bdc tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca" status: 404 len: 111 microversion: 2.1 time: 0.031465 Oct 17 03:58:58.550491 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 398/797] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:58:58 2022] GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 03:58:58.556504 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-8d7e0d57-938e-453b-a1a3-b4f244f1c83e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '.version_select at 0x7fd72a637d30>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:58.634496 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-8d7e0d57-938e-453b-a1a3-b4f244f1c83e tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1209713416" status: 202 len: 0 microversion: 2.1 time: 0.082818 Oct 17 03:58:58.635123 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 400/798] 10.222.0.16 () {58 vars in 1221 bytes} [Mon Oct 17 03:58:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1209713416 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 03:58:58.696531 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-26786e0c-4c36-4b4e-aeef-97c7294b05d5 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:58.697161 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-26786e0c-4c36-4b4e-aeef-97c7294b05d5 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] [instance: d471c80c-12be-4e18-89d6-d64601602d39] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:58.703207 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-26786e0c-4c36-4b4e-aeef-97c7294b05d5 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:58.703717 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-26786e0c-4c36-4b4e-aeef-97c7294b05d5 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:58.704150 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-26786e0c-4c36-4b4e-aeef-97c7294b05d5 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:58.704847 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-26786e0c-4c36-4b4e-aeef-97c7294b05d5 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:58.705492 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-26786e0c-4c36-4b4e-aeef-97c7294b05d5 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:58.706100 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-26786e0c-4c36-4b4e-aeef-97c7294b05d5 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:58.773404 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-f51ce4da-a9bc-410b-af2b-6d0105e34471 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:58.774327 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-f51ce4da-a9bc-410b-af2b-6d0105e34471 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:58.781368 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f51ce4da-a9bc-410b-af2b-6d0105e34471 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:58.781979 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f51ce4da-a9bc-410b-af2b-6d0105e34471 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:58.782505 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f51ce4da-a9bc-410b-af2b-6d0105e34471 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:58.783459 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f51ce4da-a9bc-410b-af2b-6d0105e34471 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:58.784038 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f51ce4da-a9bc-410b-af2b-6d0105e34471 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:58.785612 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f51ce4da-a9bc-410b-af2b-6d0105e34471 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:58.862675 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-26786e0c-4c36-4b4e-aeef-97c7294b05d5 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b22f27c7144a3d96f41747473fe646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0a418ceb742fdb01c98c5d58424a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:58.873645 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-26786e0c-4c36-4b4e-aeef-97c7294b05d5 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] 10.222.0.16 "GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39" status: 200 len: 1566 microversion: 2.1 time: 0.181227 Oct 17 03:58:58.874625 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 399/799] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:58:58 2022] GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39 => generated 1566 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:58:58.879957 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-8a2981d1-b256-4860-904e-fe139db4486d tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:58.880821 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-8a2981d1-b256-4860-904e-fe139db4486d tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 15a2e41f-4480-429c-9207-8d95daa186f5] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:58.896235 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8a2981d1-b256-4860-904e-fe139db4486d tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:58.897152 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8a2981d1-b256-4860-904e-fe139db4486d tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:58.897568 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8a2981d1-b256-4860-904e-fe139db4486d tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:58.898344 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8a2981d1-b256-4860-904e-fe139db4486d tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:58.898905 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8a2981d1-b256-4860-904e-fe139db4486d tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:58.899493 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8a2981d1-b256-4860-904e-fe139db4486d tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:58.914876 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.wsgi [None req-8a2981d1-b256-4860-904e-fe139db4486d tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] HTTP exception thrown: Instance 15a2e41f-4480-429c-9207-8d95daa186f5 could not be found. Oct 17 03:58:58.916474 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-8a2981d1-b256-4860-904e-fe139db4486d tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Request method failure captured: Oct 17 03:58:58.916474 dv-cinder-815582-16-smb devstack@n-api.service[125872]: request: GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5 HTTP/1.1 Oct 17 03:58:58.916474 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Accept: application/json Oct 17 03:58:58.916474 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Accept-Encoding: identity Oct 17 03:58:58.916474 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Connection: close Oct 17 03:58:58.916474 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Content-Length: 0 Oct 17 03:58:58.916474 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Content-Type: application/json Oct 17 03:58:58.916474 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Host: 10.222.0.16 Oct 17 03:58:58.916474 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Openstack-System-Scope: None Oct 17 03:58:58.916474 dv-cinder-815582-16-smb devstack@n-api.service[125872]: User-Agent: python-urllib3/1.26.12 Oct 17 03:58:58.916474 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Auth-Token: gAAAAABjTNHYLxUsgcq_ACPqiARQRHFZX3xLv8SayCvNAWGNHgFQpkcgEDanwG27BF2rHPhh0X13DIu7TiIER2OGNrGDta7scBiyr4QHstEFtiE-NGtlSlpYsVJP4E4zCTmikL_tTbEERMy_oJ_SGh8iD1-z3BXcak8DQ79G1K_sLtgABtxSp2A Oct 17 03:58:58.916474 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Domain-Id: None Oct 17 03:58:58.916474 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Domain-Name: None Oct 17 03:58:58.916474 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Identity-Status: Confirmed Oct 17 03:58:58.916474 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Is-Admin-Project: True Oct 17 03:58:58.916474 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Domain-Id: default Oct 17 03:58:58.916474 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Domain-Name: Default Oct 17 03:58:58.916474 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Id: b033d35610f34401a99b912f145eb317 Oct 17 03:58:58.916474 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-464495139 Oct 17 03:58:58.916474 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Role: reader,member Oct 17 03:58:58.916474 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Roles: reader,member Oct 17 03:58:58.917798 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b033d35610f34401a99b912f145eb317"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b033d35610f34401a99b912f145eb317"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b033d35610f34401a99b912f145eb317"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b033d35610f34401a99b912f145eb317", "adminURL": "http://10.222.0.16:8080"}]}] Oct 17 03:58:58.917798 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant: tempest-ServerRescueNegativeTestJSON-464495139 Oct 17 03:58:58.917798 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant-Id: b033d35610f34401a99b912f145eb317 Oct 17 03:58:58.917798 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-464495139 Oct 17 03:58:58.917798 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User: tempest-ServerRescueNegativeTestJSON-464495139-project Oct 17 03:58:58.917798 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Domain-Id: default Oct 17 03:58:58.917798 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Domain-Name: Default Oct 17 03:58:58.917798 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Id: fa0a6947667d48bfabf6aefad09c8325 Oct 17 03:58:58.917798 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Name: tempest-ServerRescueNegativeTestJSON-464495139-project Oct 17 03:58:58.917798 dv-cinder-815582-16-smb devstack@n-api.service[125872]: method: > Oct 17 03:58:58.917798 dv-cinder-815582-16-smb devstack@n-api.service[125872]: exception: Instance 15a2e41f-4480-429c-9207-8d95daa186f5 could not be found. Oct 17 03:58:58.917798 dv-cinder-815582-16-smb devstack@n-api.service[125872]: action_args: {'id': '15a2e41f-4480-429c-9207-8d95daa186f5'} Oct 17 03:58:58.918711 dv-cinder-815582-16-smb devstack@n-api.service[125872]: {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:58:58.918711 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:58:58.918711 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 03:58:58.918711 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 03:58:58.918711 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 03:58:58.918711 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 03:58:58.918711 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 03:58:58.918711 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 03:58:58.918711 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 03:58:58.918711 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 03:58:58.918711 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15a2e41f-4480-429c-9207-8d95daa186f5 could not be found. Oct 17 03:58:58.918711 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:58:58.918711 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:58:58.918711 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:58:58.918711 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:58:58.918711 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:58:58.918711 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:58:58.918711 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:58:58.918711 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:58:58.918711 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:58:58.925473 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:58:58.925473 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 03:58:58.925473 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 03:58:58.925473 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 03:58:58.925473 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 03:58:58.925473 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 03:58:58.925473 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:58:58.925473 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15a2e41f-4480-429c-9207-8d95daa186f5 could not be found. Oct 17 03:58:58.925473 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:58:58.925473 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:58:58.925473 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:58:58.925473 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:58:58.925473 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:58:58.925473 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:58:58.925473 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:58:58.925473 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:58:58.925473 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15a2e41f-4480-429c-9207-8d95daa186f5 could not be found. Oct 17 03:58:58.925473 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:58:58.927273 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-8a2981d1-b256-4860-904e-fe139db4486d tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Returning 404 to user: Instance 15a2e41f-4480-429c-9207-8d95daa186f5 could not be found. {{(pid=125872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:58:58.927273 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-8a2981d1-b256-4860-904e-fe139db4486d tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5" status: 404 len: 111 microversion: 2.1 time: 0.041598 Oct 17 03:58:58.927273 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 400/800] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:58:58 2022] GET /compute/v2.1/servers/15a2e41f-4480-429c-9207-8d95daa186f5 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 03:58:58.932575 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-69a7b99e-d9b4-4785-817b-427fc7abe588 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:58.933160 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-69a7b99e-d9b4-4785-817b-427fc7abe588 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 06e9c5ca-8770-4ed5-90ae-bad248ab7ff7] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:58.939941 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-69a7b99e-d9b4-4785-817b-427fc7abe588 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:58.940823 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-69a7b99e-d9b4-4785-817b-427fc7abe588 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:58.941500 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-69a7b99e-d9b4-4785-817b-427fc7abe588 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:58.942384 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-69a7b99e-d9b4-4785-817b-427fc7abe588 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:58.942949 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-69a7b99e-d9b4-4785-817b-427fc7abe588 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:58.943510 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-69a7b99e-d9b4-4785-817b-427fc7abe588 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:58.971599 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-69a7b99e-d9b4-4785-817b-427fc7abe588 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 06e9c5ca-8770-4ed5-90ae-bad248ab7ff7] Going to try to terminate instance {{(pid=125872) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 03:58:59.020462 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-f51ce4da-a9bc-410b-af2b-6d0105e34471 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:59.024940 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:58:59.032988 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:58:59.035990 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-f51ce4da-a9bc-410b-af2b-6d0105e34471 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:59.037589 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-f51ce4da-a9bc-410b-af2b-6d0105e34471 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:59.039216 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-f51ce4da-a9bc-410b-af2b-6d0105e34471 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6" status: 200 len: 1405 microversion: 2.20 time: 0.269595 Oct 17 03:58:59.039931 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 401/801] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:58:58 2022] GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6 => generated 1405 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:58:59.325945 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-69a7b99e-d9b4-4785-817b-427fc7abe588 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "DELETE /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7" status: 204 len: 0 microversion: 2.1 time: 0.396227 Oct 17 03:58:59.328025 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 401/802] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 17 03:58:58 2022] DELETE /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 03:58:59.339293 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-1c746882-e005-4ec4-8ff7-10dcf0213165 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:59.339990 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-1c746882-e005-4ec4-8ff7-10dcf0213165 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 06e9c5ca-8770-4ed5-90ae-bad248ab7ff7] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:59.346827 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1c746882-e005-4ec4-8ff7-10dcf0213165 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:59.347339 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1c746882-e005-4ec4-8ff7-10dcf0213165 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:59.347773 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1c746882-e005-4ec4-8ff7-10dcf0213165 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:59.348465 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1c746882-e005-4ec4-8ff7-10dcf0213165 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:59.348914 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1c746882-e005-4ec4-8ff7-10dcf0213165 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:59.349327 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1c746882-e005-4ec4-8ff7-10dcf0213165 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:59.492331 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-b9202178-3d33-48af-89b8-bcf5687b2f52 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Action: 'create', calling method: .version_select at 0x7fd72a58f5e0>, body: {"keypair": {"name": "tempest-keypair-1864344103", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI6iGlli1IZjzlPS1Y7noyYlKcOsK+fsHPIReZy3M/vJoVpzR4GleSdHhLIEyjvZgEKQMShH4T6SpAZ5kj8I2zu9X1td8SohvqzCLXCvKLCsYbYPvQF9rXf2vfS+QQ/ESw=="}} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:58:59.495207 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-1c746882-e005-4ec4-8ff7-10dcf0213165 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:58:59.503407 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-1c746882-e005-4ec4-8ff7-10dcf0213165 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7" status: 200 len: 1521 microversion: 2.1 time: 0.167996 Oct 17 03:58:59.510098 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 402/803] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:58:59 2022] GET /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:58:59.510219 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.quota [None req-b9202178-3d33-48af-89b8-bcf5687b2f52 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Getting quotas for project 8af3ce80f169473882a247ba78d3d6ef. Resources: {'key_pairs'} {{(pid=125872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 03:58:59.513538 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.quota [None req-b9202178-3d33-48af-89b8-bcf5687b2f52 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Getting quotas for user e9ac14bb6ceb4d9a92a20938e9688bbd and project 8af3ce80f169473882a247ba78d3d6ef. Resources: {'key_pairs'} {{(pid=125872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 03:58:59.611863 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-b9202178-3d33-48af-89b8-bcf5687b2f52 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.123881 Oct 17 03:58:59.612508 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 402/804] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 17 03:58:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 03:58:59.898141 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-0a2b64f2-b5d6-4ef0-8698-d88b9e34343d tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:58:59.898876 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-0a2b64f2-b5d6-4ef0-8698-d88b9e34343d tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] [instance: d471c80c-12be-4e18-89d6-d64601602d39] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:58:59.905706 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0a2b64f2-b5d6-4ef0-8698-d88b9e34343d tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:59.906189 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0a2b64f2-b5d6-4ef0-8698-d88b9e34343d tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:59.906623 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0a2b64f2-b5d6-4ef0-8698-d88b9e34343d tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:58:59.907349 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0a2b64f2-b5d6-4ef0-8698-d88b9e34343d tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:58:59.907810 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0a2b64f2-b5d6-4ef0-8698-d88b9e34343d tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:58:59.908230 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0a2b64f2-b5d6-4ef0-8698-d88b9e34343d tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:00.041701 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-0a2b64f2-b5d6-4ef0-8698-d88b9e34343d tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b22f27c7144a3d96f41747473fe646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0a418ceb742fdb01c98c5d58424a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:00.049882 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-0a2b64f2-b5d6-4ef0-8698-d88b9e34343d tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] 10.222.0.16 "GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39" status: 200 len: 1566 microversion: 2.1 time: 0.156077 Oct 17 03:59:00.050866 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 403/805] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:58:59 2022] GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:59:00.063466 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-27ab1604-fdfe-4071-9a6c-6e6685064876 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:00.064207 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-27ab1604-fdfe-4071-9a6c-6e6685064876 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:00.071045 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-27ab1604-fdfe-4071-9a6c-6e6685064876 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:00.071563 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-27ab1604-fdfe-4071-9a6c-6e6685064876 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:00.072002 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-27ab1604-fdfe-4071-9a6c-6e6685064876 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:00.072702 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-27ab1604-fdfe-4071-9a6c-6e6685064876 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:00.073165 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-27ab1604-fdfe-4071-9a6c-6e6685064876 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:00.073626 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-27ab1604-fdfe-4071-9a6c-6e6685064876 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:00.226519 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-27ab1604-fdfe-4071-9a6c-6e6685064876 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:00.235326 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-27ab1604-fdfe-4071-9a6c-6e6685064876 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:00.236779 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-27ab1604-fdfe-4071-9a6c-6e6685064876 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:00.239281 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-27ab1604-fdfe-4071-9a6c-6e6685064876 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6" status: 200 len: 1405 microversion: 2.20 time: 0.178552 Oct 17 03:59:00.239281 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 403/806] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:59:00 2022] GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6 => generated 1405 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:59:00.532849 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-0296d669-4b16-41c9-af96-238a7ec1f73f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:00.533465 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-0296d669-4b16-41c9-af96-238a7ec1f73f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 06e9c5ca-8770-4ed5-90ae-bad248ab7ff7] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:00.539815 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0296d669-4b16-41c9-af96-238a7ec1f73f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:00.540253 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0296d669-4b16-41c9-af96-238a7ec1f73f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:00.540575 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0296d669-4b16-41c9-af96-238a7ec1f73f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:00.541361 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0296d669-4b16-41c9-af96-238a7ec1f73f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:00.541902 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0296d669-4b16-41c9-af96-238a7ec1f73f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:00.542331 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0296d669-4b16-41c9-af96-238a7ec1f73f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:00.679907 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-0296d669-4b16-41c9-af96-238a7ec1f73f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:00.687636 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-0296d669-4b16-41c9-af96-238a7ec1f73f tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7" status: 200 len: 1521 microversion: 2.1 time: 0.158814 Oct 17 03:59:00.688314 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 404/807] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:59:00 2022] GET /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:59:01.074014 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-a9d9ab16-89f0-4d0e-ba46-30832b5ae222 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:01.074702 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-a9d9ab16-89f0-4d0e-ba46-30832b5ae222 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] [instance: d471c80c-12be-4e18-89d6-d64601602d39] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:01.081985 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a9d9ab16-89f0-4d0e-ba46-30832b5ae222 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:01.082556 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a9d9ab16-89f0-4d0e-ba46-30832b5ae222 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:01.083095 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a9d9ab16-89f0-4d0e-ba46-30832b5ae222 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:01.084051 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a9d9ab16-89f0-4d0e-ba46-30832b5ae222 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:01.084488 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a9d9ab16-89f0-4d0e-ba46-30832b5ae222 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:01.084923 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a9d9ab16-89f0-4d0e-ba46-30832b5ae222 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:01.262356 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-f50c6cf8-2733-4763-bb96-a5026cddbff8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:01.263275 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-f50c6cf8-2733-4763-bb96-a5026cddbff8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:01.267432 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-a9d9ab16-89f0-4d0e-ba46-30832b5ae222 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b22f27c7144a3d96f41747473fe646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0a418ceb742fdb01c98c5d58424a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:01.269976 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f50c6cf8-2733-4763-bb96-a5026cddbff8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:01.270458 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f50c6cf8-2733-4763-bb96-a5026cddbff8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:01.270888 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f50c6cf8-2733-4763-bb96-a5026cddbff8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:01.271812 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f50c6cf8-2733-4763-bb96-a5026cddbff8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:01.272266 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f50c6cf8-2733-4763-bb96-a5026cddbff8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:01.272734 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f50c6cf8-2733-4763-bb96-a5026cddbff8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:01.276190 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-a9d9ab16-89f0-4d0e-ba46-30832b5ae222 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] 10.222.0.16 "GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39" status: 200 len: 1566 microversion: 2.1 time: 0.206118 Oct 17 03:59:01.276819 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 404/808] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:59:01 2022] GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39 => generated 1566 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:59:01.408114 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-f50c6cf8-2733-4763-bb96-a5026cddbff8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:01.416638 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-f50c6cf8-2733-4763-bb96-a5026cddbff8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:01.418074 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-f50c6cf8-2733-4763-bb96-a5026cddbff8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:01.419784 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-f50c6cf8-2733-4763-bb96-a5026cddbff8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6" status: 200 len: 1405 microversion: 2.20 time: 0.160786 Oct 17 03:59:01.420341 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 405/809] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:59:01 2022] GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6 => generated 1405 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:59:01.711292 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-0396efe6-5979-4604-a322-110e4419bbd4 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:01.712015 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-0396efe6-5979-4604-a322-110e4419bbd4 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 06e9c5ca-8770-4ed5-90ae-bad248ab7ff7] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:01.715212 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_cell0:SELECT=2 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:59:01.719480 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0396efe6-5979-4604-a322-110e4419bbd4 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:01.719974 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0396efe6-5979-4604-a322-110e4419bbd4 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:01.720414 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0396efe6-5979-4604-a322-110e4419bbd4 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:01.721125 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0396efe6-5979-4604-a322-110e4419bbd4 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:01.721582 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0396efe6-5979-4604-a322-110e4419bbd4 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:01.722010 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0396efe6-5979-4604-a322-110e4419bbd4 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:02.098630 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-0396efe6-5979-4604-a322-110e4419bbd4 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:02.110259 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-0396efe6-5979-4604-a322-110e4419bbd4 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7" status: 200 len: 1521 microversion: 2.1 time: 0.398905 Oct 17 03:59:02.110259 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 405/810] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:59:01 2022] GET /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7 => generated 1521 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:59:02.299412 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-72b61767-1a16-4359-9600-554446319cc3 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:02.300397 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-72b61767-1a16-4359-9600-554446319cc3 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] [instance: d471c80c-12be-4e18-89d6-d64601602d39] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:02.306353 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-72b61767-1a16-4359-9600-554446319cc3 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:02.306842 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-72b61767-1a16-4359-9600-554446319cc3 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:02.307320 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-72b61767-1a16-4359-9600-554446319cc3 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:02.308018 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-72b61767-1a16-4359-9600-554446319cc3 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:02.308474 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-72b61767-1a16-4359-9600-554446319cc3 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:02.308905 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-72b61767-1a16-4359-9600-554446319cc3 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:02.330501 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-27a33b48-2269-40d8-80e4-bdc785e792d0 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1329507431", "imageRef": "add1979e-0a3b-4403-a8ae-8d9a7b045fc2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "08dcfdbc-aaeb-49ae-86ff-471831242857"}], "security_groups": [{"name": "tempest-securitygroup--2027212046"}], "key_name": "tempest-keypair-1864344103", "user_data": "}} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:59:02.444485 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-72b61767-1a16-4359-9600-554446319cc3 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b22f27c7144a3d96f41747473fe646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0a418ceb742fdb01c98c5d58424a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:02.450200 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.network.neutron [None req-27a33b48-2269-40d8-80e4-bdc785e792d0 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] validate_networks() for [('08dcfdbc-aaeb-49ae-86ff-471831242857', None, None, None, None, None)] {{(pid=125872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 03:59:02.453214 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-72b61767-1a16-4359-9600-554446319cc3 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] 10.222.0.16 "GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39" status: 200 len: 1566 microversion: 2.1 time: 0.157747 Oct 17 03:59:02.453966 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 406/811] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:59:02 2022] GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:59:02.458479 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-3b73c6a1-9961-43be-a6c7-50f936e688e4 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:02.459429 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-3b73c6a1-9961-43be-a6c7-50f936e688e4 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:02.465698 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3b73c6a1-9961-43be-a6c7-50f936e688e4 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:02.466267 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3b73c6a1-9961-43be-a6c7-50f936e688e4 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:02.466775 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3b73c6a1-9961-43be-a6c7-50f936e688e4 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:02.467696 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3b73c6a1-9961-43be-a6c7-50f936e688e4 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:02.468167 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3b73c6a1-9961-43be-a6c7-50f936e688e4 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:02.468582 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3b73c6a1-9961-43be-a6c7-50f936e688e4 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:02.600504 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-3b73c6a1-9961-43be-a6c7-50f936e688e4 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:02.609687 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-3b73c6a1-9961-43be-a6c7-50f936e688e4 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:02.611074 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-3b73c6a1-9961-43be-a6c7-50f936e688e4 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:02.612247 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-3b73c6a1-9961-43be-a6c7-50f936e688e4 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6" status: 200 len: 1405 microversion: 2.20 time: 0.157291 Oct 17 03:59:02.612818 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 407/812] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:59:02 2022] GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6 => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:59:02.814508 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.virt.hardware [None req-27a33b48-2269-40d8-80e4-bdc785e792d0 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Flavor limits 0:0:0 {{(pid=125872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 03:59:02.814957 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.virt.hardware [None req-27a33b48-2269-40d8-80e4-bdc785e792d0 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Image limits 0:0:0 {{(pid=125872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 03:59:02.815448 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.virt.hardware [None req-27a33b48-2269-40d8-80e4-bdc785e792d0 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Flavor pref 0:0:0 {{(pid=125872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 03:59:02.815865 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.virt.hardware [None req-27a33b48-2269-40d8-80e4-bdc785e792d0 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Image pref 0:0:0 {{(pid=125872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 03:59:02.816281 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.virt.hardware [None req-27a33b48-2269-40d8-80e4-bdc785e792d0 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 03:59:02.825184 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-27a33b48-2269-40d8-80e4-bdc785e792d0 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:02.825671 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-27a33b48-2269-40d8-80e4-bdc785e792d0 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:02.826112 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-27a33b48-2269-40d8-80e4-bdc785e792d0 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:02.826848 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-27a33b48-2269-40d8-80e4-bdc785e792d0 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:02.827352 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-27a33b48-2269-40d8-80e4-bdc785e792d0 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:02.827788 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-27a33b48-2269-40d8-80e4-bdc785e792d0 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:02.844220 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.quota [None req-27a33b48-2269-40d8-80e4-bdc785e792d0 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Getting quotas for project 8af3ce80f169473882a247ba78d3d6ef. Resources: {'cores', 'instances', 'ram'} {{(pid=125872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 03:59:02.848165 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.quota [None req-27a33b48-2269-40d8-80e4-bdc785e792d0 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Getting quotas for user e9ac14bb6ceb4d9a92a20938e9688bbd and project 8af3ce80f169473882a247ba78d3d6ef. Resources: {'cores', 'instances', 'ram'} {{(pid=125872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 03:59:02.859444 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-27a33b48-2269-40d8-80e4-bdc785e792d0 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Going to run 1 instances... {{(pid=125872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 03:59:02.861744 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-27a33b48-2269-40d8-80e4-bdc785e792d0 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 9777f592-2e10-475d-b716-a98d5f1c3c4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='add1979e-0a3b-4403-a8ae-8d9a7b045fc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 03:59:03.003512 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-27a33b48-2269-40d8-80e4-bdc785e792d0 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.677812 Oct 17 03:59:03.004160 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 406/813] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 17 03:59:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 03:59:03.016501 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-3a140c5a-3199-4918-bc38-e02ec494752b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:03.017556 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-3a140c5a-3199-4918-bc38-e02ec494752b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 9777f592-2e10-475d-b716-a98d5f1c3c4d] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:03.078907 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-3a140c5a-3199-4918-bc38-e02ec494752b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:03.086012 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-3a140c5a-3199-4918-bc38-e02ec494752b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/9777f592-2e10-475d-b716-a98d5f1c3c4d" status: 200 len: 1242 microversion: 2.1 time: 0.074357 Oct 17 03:59:03.086460 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 408/814] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:59:03 2022] GET /compute/v2.1/servers/9777f592-2e10-475d-b716-a98d5f1c3c4d => generated 1242 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:59:03.129471 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-8571a0bf-6280-48e5-92ed-720d8e266844 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:03.130089 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-8571a0bf-6280-48e5-92ed-720d8e266844 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 06e9c5ca-8770-4ed5-90ae-bad248ab7ff7] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:03.137298 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8571a0bf-6280-48e5-92ed-720d8e266844 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:03.138054 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8571a0bf-6280-48e5-92ed-720d8e266844 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:03.138494 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8571a0bf-6280-48e5-92ed-720d8e266844 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:03.139219 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8571a0bf-6280-48e5-92ed-720d8e266844 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:03.139718 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8571a0bf-6280-48e5-92ed-720d8e266844 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:03.140148 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8571a0bf-6280-48e5-92ed-720d8e266844 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:03.276197 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-8571a0bf-6280-48e5-92ed-720d8e266844 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:03.284769 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-8571a0bf-6280-48e5-92ed-720d8e266844 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7" status: 200 len: 1521 microversion: 2.1 time: 0.159209 Oct 17 03:59:03.285368 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 407/815] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:59:03 2022] GET /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:59:03.476940 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-02610b3b-5187-45c1-afb6-e93387169d3d tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:03.477579 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-02610b3b-5187-45c1-afb6-e93387169d3d tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] [instance: d471c80c-12be-4e18-89d6-d64601602d39] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:03.484918 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-02610b3b-5187-45c1-afb6-e93387169d3d tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:03.485405 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-02610b3b-5187-45c1-afb6-e93387169d3d tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:03.486015 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-02610b3b-5187-45c1-afb6-e93387169d3d tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:03.486882 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-02610b3b-5187-45c1-afb6-e93387169d3d tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:03.487367 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-02610b3b-5187-45c1-afb6-e93387169d3d tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:03.487849 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-02610b3b-5187-45c1-afb6-e93387169d3d tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:03.639116 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-a21dbbf3-7b1d-48fa-b577-930d353fb856 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:03.640039 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-a21dbbf3-7b1d-48fa-b577-930d353fb856 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:03.646068 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a21dbbf3-7b1d-48fa-b577-930d353fb856 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:03.646665 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a21dbbf3-7b1d-48fa-b577-930d353fb856 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:03.647210 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a21dbbf3-7b1d-48fa-b577-930d353fb856 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:03.648257 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a21dbbf3-7b1d-48fa-b577-930d353fb856 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:03.648803 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a21dbbf3-7b1d-48fa-b577-930d353fb856 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:03.649403 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a21dbbf3-7b1d-48fa-b577-930d353fb856 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:03.689241 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-02610b3b-5187-45c1-afb6-e93387169d3d tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b22f27c7144a3d96f41747473fe646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0a418ceb742fdb01c98c5d58424a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:03.703033 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-02610b3b-5187-45c1-afb6-e93387169d3d tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] 10.222.0.16 "GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39" status: 200 len: 1566 microversion: 2.1 time: 0.229955 Oct 17 03:59:03.715240 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 409/816] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:59:03 2022] GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39 => generated 1566 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:59:03.755558 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [req-74abb1f1-2da3-43bd-894c-69b54b187140 req-1df783db-b781-4ac2-8945-817dd1f38669 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5d69048-2557-4e13-92de-3381030814e6", "name": "network-vif-plugged", "status": "completed", "tag": "4983815b-2774-4cc1-a815-084c70865641"}]} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:59:03.766785 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-74abb1f1-2da3-43bd-894c-69b54b187140 req-1df783db-b781-4ac2-8945-817dd1f38669 service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:03.768376 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-74abb1f1-2da3-43bd-894c-69b54b187140 req-1df783db-b781-4ac2-8945-817dd1f38669 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:03.768376 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-74abb1f1-2da3-43bd-894c-69b54b187140 req-1df783db-b781-4ac2-8945-817dd1f38669 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:03.779398 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.compute.server_external_events [req-74abb1f1-2da3-43bd-894c-69b54b187140 req-1df783db-b781-4ac2-8945-817dd1f38669 service nova] Creating event network-vif-plugged:4983815b-2774-4cc1-a815-084c70865641 for instance e5d69048-2557-4e13-92de-3381030814e6 on hv-cinder-81558 Oct 17 03:59:03.784528 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [req-74abb1f1-2da3-43bd-894c-69b54b187140 req-1df783db-b781-4ac2-8945-817dd1f38669 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032619 Oct 17 03:59:03.786294 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 410/817] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 03:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 03:59:03.792582 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-a21dbbf3-7b1d-48fa-b577-930d353fb856 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:03.804500 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-a21dbbf3-7b1d-48fa-b577-930d353fb856 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:03.806311 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-a21dbbf3-7b1d-48fa-b577-930d353fb856 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:03.808789 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-a21dbbf3-7b1d-48fa-b577-930d353fb856 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6" status: 200 len: 1405 microversion: 2.20 time: 0.174825 Oct 17 03:59:03.811337 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 408/818] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:59:03 2022] GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6 => generated 1405 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:59:03.899861 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [req-3f6d535d-f780-4a5d-bbb7-aff974666bc9 req-0bc3a0c0-9136-4790-854f-9bb7213e988e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06e9c5ca-8770-4ed5-90ae-bad248ab7ff7", "name": "network-vif-deleted", "tag": "2e6c9011-7760-4042-9cfb-b70dfe1712a5"}]} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:59:03.907670 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=3,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:59:03.913026 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-3f6d535d-f780-4a5d-bbb7-aff974666bc9 req-0bc3a0c0-9136-4790-854f-9bb7213e988e service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:03.913632 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-3f6d535d-f780-4a5d-bbb7-aff974666bc9 req-0bc3a0c0-9136-4790-854f-9bb7213e988e service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:03.914057 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-3f6d535d-f780-4a5d-bbb7-aff974666bc9 req-0bc3a0c0-9136-4790-854f-9bb7213e988e service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:03.924836 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.compute.server_external_events [req-3f6d535d-f780-4a5d-bbb7-aff974666bc9 req-0bc3a0c0-9136-4790-854f-9bb7213e988e service nova] Creating event network-vif-deleted:2e6c9011-7760-4042-9cfb-b70dfe1712a5 for instance 06e9c5ca-8770-4ed5-90ae-bad248ab7ff7 on hv-cinder-81558 Oct 17 03:59:03.929865 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [req-3f6d535d-f780-4a5d-bbb7-aff974666bc9 req-0bc3a0c0-9136-4790-854f-9bb7213e988e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033959 Oct 17 03:59:03.930465 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 411/819] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 03:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:59:04.112170 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-b8abdf36-48a7-4907-8bd3-d0deac293e3b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:04.112914 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-b8abdf36-48a7-4907-8bd3-d0deac293e3b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 9777f592-2e10-475d-b716-a98d5f1c3c4d] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:04.119345 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b8abdf36-48a7-4907-8bd3-d0deac293e3b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:04.120067 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b8abdf36-48a7-4907-8bd3-d0deac293e3b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:04.120572 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b8abdf36-48a7-4907-8bd3-d0deac293e3b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:04.121337 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b8abdf36-48a7-4907-8bd3-d0deac293e3b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:04.121859 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b8abdf36-48a7-4907-8bd3-d0deac293e3b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:04.122345 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b8abdf36-48a7-4907-8bd3-d0deac293e3b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:04.191022 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-b8abdf36-48a7-4907-8bd3-d0deac293e3b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:04.199960 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-b8abdf36-48a7-4907-8bd3-d0deac293e3b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/9777f592-2e10-475d-b716-a98d5f1c3c4d" status: 200 len: 1246 microversion: 2.1 time: 0.094906 Oct 17 03:59:04.201102 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 409/820] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:59:04 2022] GET /compute/v2.1/servers/9777f592-2e10-475d-b716-a98d5f1c3c4d => generated 1246 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:59:04.314008 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-ec92a0d0-ad81-4c4a-b1a9-594d8889b133 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:04.314817 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-ec92a0d0-ad81-4c4a-b1a9-594d8889b133 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 06e9c5ca-8770-4ed5-90ae-bad248ab7ff7] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:04.322836 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ec92a0d0-ad81-4c4a-b1a9-594d8889b133 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:04.323402 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ec92a0d0-ad81-4c4a-b1a9-594d8889b133 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:04.323860 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ec92a0d0-ad81-4c4a-b1a9-594d8889b133 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:04.324566 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ec92a0d0-ad81-4c4a-b1a9-594d8889b133 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:04.325024 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ec92a0d0-ad81-4c4a-b1a9-594d8889b133 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:04.325502 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ec92a0d0-ad81-4c4a-b1a9-594d8889b133 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:04.360773 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ec92a0d0-ad81-4c4a-b1a9-594d8889b133 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:04.361262 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ec92a0d0-ad81-4c4a-b1a9-594d8889b133 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:04.361698 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ec92a0d0-ad81-4c4a-b1a9-594d8889b133 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:04.363193 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.objects.instance [None req-ec92a0d0-ad81-4c4a-b1a9-594d8889b133 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lazy-loading 'fault' on Instance uuid 06e9c5ca-8770-4ed5-90ae-bad248ab7ff7 {{(pid=125871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:59:04.404761 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-ec92a0d0-ad81-4c4a-b1a9-594d8889b133 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:04.412441 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-ec92a0d0-ad81-4c4a-b1a9-594d8889b133 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7" status: 200 len: 1312 microversion: 2.1 time: 0.104088 Oct 17 03:59:04.413042 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 412/821] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:59:04 2022] GET /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7 => generated 1312 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:59:04.726927 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-01edb90e-123b-4f16-adef-2cac201ead75 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:04.727572 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-01edb90e-123b-4f16-adef-2cac201ead75 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] [instance: d471c80c-12be-4e18-89d6-d64601602d39] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:04.734216 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-01edb90e-123b-4f16-adef-2cac201ead75 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:04.734700 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-01edb90e-123b-4f16-adef-2cac201ead75 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:04.735137 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-01edb90e-123b-4f16-adef-2cac201ead75 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:04.735857 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-01edb90e-123b-4f16-adef-2cac201ead75 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:04.736315 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-01edb90e-123b-4f16-adef-2cac201ead75 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:04.736738 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-01edb90e-123b-4f16-adef-2cac201ead75 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:04.837466 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-f39e7e67-19be-4f30-a36b-c105b73d79cb tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:04.838082 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-f39e7e67-19be-4f30-a36b-c105b73d79cb tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:04.845669 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f39e7e67-19be-4f30-a36b-c105b73d79cb tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:04.846158 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f39e7e67-19be-4f30-a36b-c105b73d79cb tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:04.846602 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f39e7e67-19be-4f30-a36b-c105b73d79cb tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:04.847340 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f39e7e67-19be-4f30-a36b-c105b73d79cb tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:04.847801 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f39e7e67-19be-4f30-a36b-c105b73d79cb tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:04.848228 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f39e7e67-19be-4f30-a36b-c105b73d79cb tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:04.873500 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-01edb90e-123b-4f16-adef-2cac201ead75 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b22f27c7144a3d96f41747473fe646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0a418ceb742fdb01c98c5d58424a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:04.881351 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-01edb90e-123b-4f16-adef-2cac201ead75 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] 10.222.0.16 "GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39" status: 200 len: 1566 microversion: 2.1 time: 0.158201 Oct 17 03:59:04.882127 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 410/822] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:59:04 2022] GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:59:04.981602 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-f39e7e67-19be-4f30-a36b-c105b73d79cb tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:04.989446 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-f39e7e67-19be-4f30-a36b-c105b73d79cb tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:04.990878 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-f39e7e67-19be-4f30-a36b-c105b73d79cb tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:04.992001 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-f39e7e67-19be-4f30-a36b-c105b73d79cb tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6" status: 200 len: 1405 microversion: 2.20 time: 0.158920 Oct 17 03:59:04.992589 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 413/823] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:59:04 2022] GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6 => generated 1405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:59:05.223431 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-2b67f9d9-4db1-4153-b0db-7650d341e6a2 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:05.224042 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-2b67f9d9-4db1-4153-b0db-7650d341e6a2 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 9777f592-2e10-475d-b716-a98d5f1c3c4d] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:05.230355 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2b67f9d9-4db1-4153-b0db-7650d341e6a2 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:05.230776 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2b67f9d9-4db1-4153-b0db-7650d341e6a2 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:05.231229 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2b67f9d9-4db1-4153-b0db-7650d341e6a2 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:05.231980 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2b67f9d9-4db1-4153-b0db-7650d341e6a2 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:05.232782 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2b67f9d9-4db1-4153-b0db-7650d341e6a2 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:05.232882 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2b67f9d9-4db1-4153-b0db-7650d341e6a2 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:05.294066 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-2b67f9d9-4db1-4153-b0db-7650d341e6a2 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:05.301639 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-2b67f9d9-4db1-4153-b0db-7650d341e6a2 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/9777f592-2e10-475d-b716-a98d5f1c3c4d" status: 200 len: 1238 microversion: 2.1 time: 0.082198 Oct 17 03:59:05.302204 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 411/824] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:59:05 2022] GET /compute/v2.1/servers/9777f592-2e10-475d-b716-a98d5f1c3c4d => generated 1238 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:59:05.436879 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-f4054164-c141-4a60-884c-aeb07408777c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:05.437770 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-f4054164-c141-4a60-884c-aeb07408777c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 06e9c5ca-8770-4ed5-90ae-bad248ab7ff7] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:05.447229 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f4054164-c141-4a60-884c-aeb07408777c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:05.447739 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f4054164-c141-4a60-884c-aeb07408777c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:05.448182 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f4054164-c141-4a60-884c-aeb07408777c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:05.448892 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f4054164-c141-4a60-884c-aeb07408777c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:05.449355 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f4054164-c141-4a60-884c-aeb07408777c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:05.449796 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f4054164-c141-4a60-884c-aeb07408777c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:05.488068 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f4054164-c141-4a60-884c-aeb07408777c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:05.488566 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f4054164-c141-4a60-884c-aeb07408777c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:05.489011 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f4054164-c141-4a60-884c-aeb07408777c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:05.489544 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.objects.instance [None req-f4054164-c141-4a60-884c-aeb07408777c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lazy-loading 'fault' on Instance uuid 06e9c5ca-8770-4ed5-90ae-bad248ab7ff7 {{(pid=125871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:59:05.534987 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-f4054164-c141-4a60-884c-aeb07408777c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0a6947667d48bfabf6aefad09c8325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b033d35610f34401a99b912f145eb317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:05.543268 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-f4054164-c141-4a60-884c-aeb07408777c tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7" status: 200 len: 1312 microversion: 2.1 time: 0.111990 Oct 17 03:59:05.543852 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 414/825] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:59:05 2022] GET /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7 => generated 1312 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:59:05.905784 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-5c1f3ba5-b3c9-434e-9a63-21faa6349125 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:05.906582 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-5c1f3ba5-b3c9-434e-9a63-21faa6349125 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] [instance: d471c80c-12be-4e18-89d6-d64601602d39] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:05.912742 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-5c1f3ba5-b3c9-434e-9a63-21faa6349125 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:05.913228 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-5c1f3ba5-b3c9-434e-9a63-21faa6349125 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:05.913694 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-5c1f3ba5-b3c9-434e-9a63-21faa6349125 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:05.914614 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-5c1f3ba5-b3c9-434e-9a63-21faa6349125 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:05.915071 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-5c1f3ba5-b3c9-434e-9a63-21faa6349125 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:05.915526 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-5c1f3ba5-b3c9-434e-9a63-21faa6349125 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:06.017736 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-e9168227-b91e-44ff-9502-b6911f902d26 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:06.018429 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-e9168227-b91e-44ff-9502-b6911f902d26 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:06.030463 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e9168227-b91e-44ff-9502-b6911f902d26 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:06.032639 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e9168227-b91e-44ff-9502-b6911f902d26 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:06.033728 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e9168227-b91e-44ff-9502-b6911f902d26 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:06.035969 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e9168227-b91e-44ff-9502-b6911f902d26 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:06.036559 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e9168227-b91e-44ff-9502-b6911f902d26 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:06.051465 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e9168227-b91e-44ff-9502-b6911f902d26 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:06.059014 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-5c1f3ba5-b3c9-434e-9a63-21faa6349125 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b22f27c7144a3d96f41747473fe646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0a418ceb742fdb01c98c5d58424a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:06.068156 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-5c1f3ba5-b3c9-434e-9a63-21faa6349125 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] 10.222.0.16 "GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39" status: 200 len: 1566 microversion: 2.1 time: 0.166278 Oct 17 03:59:06.069561 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 412/826] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:59:05 2022] GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39 => generated 1566 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:59:06.186813 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-e9168227-b91e-44ff-9502-b6911f902d26 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:06.194905 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-e9168227-b91e-44ff-9502-b6911f902d26 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:06.196423 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-e9168227-b91e-44ff-9502-b6911f902d26 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:06.197523 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-e9168227-b91e-44ff-9502-b6911f902d26 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6" status: 200 len: 1405 microversion: 2.20 time: 0.184325 Oct 17 03:59:06.198085 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 415/827] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:59:06 2022] GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6 => generated 1405 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:59:06.325165 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-594c4198-28c8-4f16-b367-b2df7a2d5857 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:06.325836 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-594c4198-28c8-4f16-b367-b2df7a2d5857 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 9777f592-2e10-475d-b716-a98d5f1c3c4d] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:06.332697 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-594c4198-28c8-4f16-b367-b2df7a2d5857 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:06.333402 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-594c4198-28c8-4f16-b367-b2df7a2d5857 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:06.333842 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-594c4198-28c8-4f16-b367-b2df7a2d5857 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:06.334546 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-594c4198-28c8-4f16-b367-b2df7a2d5857 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:06.335002 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-594c4198-28c8-4f16-b367-b2df7a2d5857 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:06.335449 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-594c4198-28c8-4f16-b367-b2df7a2d5857 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:06.397451 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-594c4198-28c8-4f16-b367-b2df7a2d5857 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:06.405602 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-594c4198-28c8-4f16-b367-b2df7a2d5857 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/9777f592-2e10-475d-b716-a98d5f1c3c4d" status: 200 len: 1294 microversion: 2.1 time: 0.084362 Oct 17 03:59:06.406180 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 413/828] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:59:06 2022] GET /compute/v2.1/servers/9777f592-2e10-475d-b716-a98d5f1c3c4d => generated 1294 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:59:06.567352 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-f29c8033-e52a-4214-beb4-a4b66db0f7a2 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:06.567960 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-f29c8033-e52a-4214-beb4-a4b66db0f7a2 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] [instance: 06e9c5ca-8770-4ed5-90ae-bad248ab7ff7] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:06.574283 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f29c8033-e52a-4214-beb4-a4b66db0f7a2 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:06.574771 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f29c8033-e52a-4214-beb4-a4b66db0f7a2 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:06.575283 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f29c8033-e52a-4214-beb4-a4b66db0f7a2 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:06.575973 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f29c8033-e52a-4214-beb4-a4b66db0f7a2 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:06.576923 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f29c8033-e52a-4214-beb4-a4b66db0f7a2 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:06.577345 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f29c8033-e52a-4214-beb4-a4b66db0f7a2 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:06.592661 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.wsgi [None req-f29c8033-e52a-4214-beb4-a4b66db0f7a2 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] HTTP exception thrown: Instance 06e9c5ca-8770-4ed5-90ae-bad248ab7ff7 could not be found. Oct 17 03:59:06.594728 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-f29c8033-e52a-4214-beb4-a4b66db0f7a2 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Request method failure captured: Oct 17 03:59:06.594728 dv-cinder-815582-16-smb devstack@n-api.service[125871]: request: GET /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7 HTTP/1.1 Oct 17 03:59:06.594728 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Accept: application/json Oct 17 03:59:06.594728 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Accept-Encoding: identity Oct 17 03:59:06.594728 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Connection: close Oct 17 03:59:06.594728 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Content-Length: 0 Oct 17 03:59:06.594728 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Content-Type: application/json Oct 17 03:59:06.594728 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Host: 10.222.0.16 Oct 17 03:59:06.594728 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Openstack-System-Scope: None Oct 17 03:59:06.594728 dv-cinder-815582-16-smb devstack@n-api.service[125871]: User-Agent: python-urllib3/1.26.12 Oct 17 03:59:06.594728 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Auth-Token: gAAAAABjTNHYLxUsgcq_ACPqiARQRHFZX3xLv8SayCvNAWGNHgFQpkcgEDanwG27BF2rHPhh0X13DIu7TiIER2OGNrGDta7scBiyr4QHstEFtiE-NGtlSlpYsVJP4E4zCTmikL_tTbEERMy_oJ_SGh8iD1-z3BXcak8DQ79G1K_sLtgABtxSp2A Oct 17 03:59:06.594728 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Domain-Id: None Oct 17 03:59:06.594728 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Domain-Name: None Oct 17 03:59:06.594728 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Identity-Status: Confirmed Oct 17 03:59:06.594728 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Is-Admin-Project: True Oct 17 03:59:06.594728 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Domain-Id: default Oct 17 03:59:06.594728 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Domain-Name: Default Oct 17 03:59:06.594728 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Id: b033d35610f34401a99b912f145eb317 Oct 17 03:59:06.594728 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-464495139 Oct 17 03:59:06.594728 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Role: reader,member Oct 17 03:59:06.594728 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Roles: reader,member Oct 17 03:59:06.596423 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b033d35610f34401a99b912f145eb317"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b033d35610f34401a99b912f145eb317"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b033d35610f34401a99b912f145eb317"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b033d35610f34401a99b912f145eb317", "adminURL": "http://10.222.0.16:8080"}]}] Oct 17 03:59:06.596423 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant: tempest-ServerRescueNegativeTestJSON-464495139 Oct 17 03:59:06.596423 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant-Id: b033d35610f34401a99b912f145eb317 Oct 17 03:59:06.596423 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-464495139 Oct 17 03:59:06.596423 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User: tempest-ServerRescueNegativeTestJSON-464495139-project Oct 17 03:59:06.596423 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Domain-Id: default Oct 17 03:59:06.596423 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Domain-Name: Default Oct 17 03:59:06.596423 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Id: fa0a6947667d48bfabf6aefad09c8325 Oct 17 03:59:06.596423 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Name: tempest-ServerRescueNegativeTestJSON-464495139-project Oct 17 03:59:06.596423 dv-cinder-815582-16-smb devstack@n-api.service[125871]: method: > Oct 17 03:59:06.596423 dv-cinder-815582-16-smb devstack@n-api.service[125871]: exception: Instance 06e9c5ca-8770-4ed5-90ae-bad248ab7ff7 could not be found. Oct 17 03:59:06.596423 dv-cinder-815582-16-smb devstack@n-api.service[125871]: action_args: {'id': '06e9c5ca-8770-4ed5-90ae-bad248ab7ff7'} Oct 17 03:59:06.597237 dv-cinder-815582-16-smb devstack@n-api.service[125871]: {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:59:06.597237 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:59:06.597237 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 03:59:06.597237 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 03:59:06.597237 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 03:59:06.597237 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 03:59:06.597237 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 03:59:06.597237 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 03:59:06.597237 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 03:59:06.597237 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 03:59:06.597237 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06e9c5ca-8770-4ed5-90ae-bad248ab7ff7 could not be found. Oct 17 03:59:06.597237 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:59:06.597237 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:59:06.597237 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:59:06.597237 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:59:06.597237 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:59:06.597237 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:59:06.597237 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:59:06.597237 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:59:06.597237 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:59:06.598572 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:59:06.598572 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 03:59:06.598572 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 03:59:06.598572 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 03:59:06.598572 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 03:59:06.598572 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 03:59:06.598572 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:59:06.598572 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06e9c5ca-8770-4ed5-90ae-bad248ab7ff7 could not be found. Oct 17 03:59:06.598572 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:59:06.598572 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:59:06.598572 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:59:06.598572 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:59:06.598572 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:59:06.598572 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:59:06.598572 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:59:06.598572 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:59:06.598572 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06e9c5ca-8770-4ed5-90ae-bad248ab7ff7 could not be found. Oct 17 03:59:06.598572 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:59:06.605303 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-f29c8033-e52a-4214-beb4-a4b66db0f7a2 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] Returning 404 to user: Instance 06e9c5ca-8770-4ed5-90ae-bad248ab7ff7 could not be found. {{(pid=125871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:59:06.605303 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-f29c8033-e52a-4214-beb4-a4b66db0f7a2 tempest-ServerRescueNegativeTestJSON-464495139 tempest-ServerRescueNegativeTestJSON-464495139-project] 10.222.0.16 "GET /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7" status: 404 len: 111 microversion: 2.1 time: 0.033354 Oct 17 03:59:06.605303 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 416/829] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:59:06 2022] GET /compute/v2.1/servers/06e9c5ca-8770-4ed5-90ae-bad248ab7ff7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 03:59:07.093215 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-0d017202-5bbe-4469-8842-4201e3eb29f6 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:07.094050 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-0d017202-5bbe-4469-8842-4201e3eb29f6 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] [instance: d471c80c-12be-4e18-89d6-d64601602d39] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:07.100015 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0d017202-5bbe-4469-8842-4201e3eb29f6 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:07.100496 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0d017202-5bbe-4469-8842-4201e3eb29f6 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:07.101140 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0d017202-5bbe-4469-8842-4201e3eb29f6 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:07.101853 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0d017202-5bbe-4469-8842-4201e3eb29f6 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:07.102306 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0d017202-5bbe-4469-8842-4201e3eb29f6 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:07.102891 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0d017202-5bbe-4469-8842-4201e3eb29f6 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:07.222310 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-d5eabe4d-1f75-41b6-a468-9548fcacddda tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:07.224134 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-d5eabe4d-1f75-41b6-a468-9548fcacddda tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:07.230485 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d5eabe4d-1f75-41b6-a468-9548fcacddda tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:07.230970 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d5eabe4d-1f75-41b6-a468-9548fcacddda tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:07.231474 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d5eabe4d-1f75-41b6-a468-9548fcacddda tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:07.233328 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d5eabe4d-1f75-41b6-a468-9548fcacddda tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:07.234089 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d5eabe4d-1f75-41b6-a468-9548fcacddda tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:07.234692 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d5eabe4d-1f75-41b6-a468-9548fcacddda tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:07.421513 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-d5eabe4d-1f75-41b6-a468-9548fcacddda tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:07.429749 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-d5eabe4d-1f75-41b6-a468-9548fcacddda tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:07.431218 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-d5eabe4d-1f75-41b6-a468-9548fcacddda tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:07.432384 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-d5eabe4d-1f75-41b6-a468-9548fcacddda tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6" status: 200 len: 1598 microversion: 2.20 time: 0.214312 Oct 17 03:59:07.432936 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 417/830] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:59:07 2022] GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6 => generated 1598 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:59:07.437862 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-489f9f92-a5bf-4a4c-ad25-242caf9a9cba tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:07.438481 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-489f9f92-a5bf-4a4c-ad25-242caf9a9cba tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 9777f592-2e10-475d-b716-a98d5f1c3c4d] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:07.445394 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-489f9f92-a5bf-4a4c-ad25-242caf9a9cba tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:07.445571 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-0d017202-5bbe-4469-8842-4201e3eb29f6 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b22f27c7144a3d96f41747473fe646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0a418ceb742fdb01c98c5d58424a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:07.446144 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-489f9f92-a5bf-4a4c-ad25-242caf9a9cba tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:07.446925 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-489f9f92-a5bf-4a4c-ad25-242caf9a9cba tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:07.447823 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-489f9f92-a5bf-4a4c-ad25-242caf9a9cba tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:07.448427 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-489f9f92-a5bf-4a4c-ad25-242caf9a9cba tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:07.448999 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-489f9f92-a5bf-4a4c-ad25-242caf9a9cba tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:07.464757 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-0d017202-5bbe-4469-8842-4201e3eb29f6 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] 10.222.0.16 "GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39" status: 200 len: 1566 microversion: 2.1 time: 0.375412 Oct 17 03:59:07.465349 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 414/831] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:59:07 2022] GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39 => generated 1566 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:59:07.480365 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-32b5549c-ceee-4c1c-8a8f-d7c91d3550f8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:07.481111 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-32b5549c-ceee-4c1c-8a8f-d7c91d3550f8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:07.495227 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-32b5549c-ceee-4c1c-8a8f-d7c91d3550f8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:07.496284 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-32b5549c-ceee-4c1c-8a8f-d7c91d3550f8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:07.496939 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-32b5549c-ceee-4c1c-8a8f-d7c91d3550f8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:07.497653 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-32b5549c-ceee-4c1c-8a8f-d7c91d3550f8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:07.498229 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-32b5549c-ceee-4c1c-8a8f-d7c91d3550f8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:07.498822 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-32b5549c-ceee-4c1c-8a8f-d7c91d3550f8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:07.650626 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-32b5549c-ceee-4c1c-8a8f-d7c91d3550f8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.174124 Oct 17 03:59:07.652261 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 415/832] 10.222.0.16 () {60 vars in 1316 bytes} [Mon Oct 17 03:59:07 2022] GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6/os-interface => generated 285 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 03:59:07.736421 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-489f9f92-a5bf-4a4c-ad25-242caf9a9cba tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:07.752598 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-489f9f92-a5bf-4a4c-ad25-242caf9a9cba tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/9777f592-2e10-475d-b716-a98d5f1c3c4d" status: 200 len: 1368 microversion: 2.1 time: 0.318597 Oct 17 03:59:07.753730 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 418/833] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:59:07 2022] GET /compute/v2.1/servers/9777f592-2e10-475d-b716-a98d5f1c3c4d => generated 1368 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:59:08.489675 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-0be42ae1-7eeb-4be8-a67a-45c804fc1beb tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:08.490964 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-0be42ae1-7eeb-4be8-a67a-45c804fc1beb tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] [instance: d471c80c-12be-4e18-89d6-d64601602d39] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:08.505094 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0be42ae1-7eeb-4be8-a67a-45c804fc1beb tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:08.505690 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0be42ae1-7eeb-4be8-a67a-45c804fc1beb tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:08.506367 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0be42ae1-7eeb-4be8-a67a-45c804fc1beb tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:08.507337 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0be42ae1-7eeb-4be8-a67a-45c804fc1beb tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:08.507811 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0be42ae1-7eeb-4be8-a67a-45c804fc1beb tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:08.508296 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0be42ae1-7eeb-4be8-a67a-45c804fc1beb tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:08.777980 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-bab3b39d-444c-4cee-9782-89e1dbb46031 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:08.778624 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-bab3b39d-444c-4cee-9782-89e1dbb46031 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 9777f592-2e10-475d-b716-a98d5f1c3c4d] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:08.786003 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-bab3b39d-444c-4cee-9782-89e1dbb46031 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:08.786742 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-bab3b39d-444c-4cee-9782-89e1dbb46031 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:08.787370 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-bab3b39d-444c-4cee-9782-89e1dbb46031 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:08.788290 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-bab3b39d-444c-4cee-9782-89e1dbb46031 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:08.788899 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-bab3b39d-444c-4cee-9782-89e1dbb46031 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:08.789884 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-bab3b39d-444c-4cee-9782-89e1dbb46031 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:09.066641 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-0be42ae1-7eeb-4be8-a67a-45c804fc1beb tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b22f27c7144a3d96f41747473fe646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0a418ceb742fdb01c98c5d58424a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:09.075616 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-0be42ae1-7eeb-4be8-a67a-45c804fc1beb tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] 10.222.0.16 "GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39" status: 200 len: 1566 microversion: 2.1 time: 0.590443 Oct 17 03:59:09.076470 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 416/834] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:59:08 2022] GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39 => generated 1566 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:59:09.147580 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-bab3b39d-444c-4cee-9782-89e1dbb46031 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:09.158850 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-bab3b39d-444c-4cee-9782-89e1dbb46031 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/9777f592-2e10-475d-b716-a98d5f1c3c4d" status: 200 len: 1368 microversion: 2.1 time: 0.384614 Oct 17 03:59:09.160134 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 419/835] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:59:08 2022] GET /compute/v2.1/servers/9777f592-2e10-475d-b716-a98d5f1c3c4d => generated 1368 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:59:09.598170 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [req-66d0d15a-625e-483c-b7ea-eaa190f0dab9 req-5a4004d9-24bd-47d2-bb1e-d42e35f8c834 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5d69048-2557-4e13-92de-3381030814e6", "tag": "4983815b-2774-4cc1-a815-084c70865641"}]} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:59:09.613692 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:59:09.627084 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-66d0d15a-625e-483c-b7ea-eaa190f0dab9 req-5a4004d9-24bd-47d2-bb1e-d42e35f8c834 service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:09.627922 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-66d0d15a-625e-483c-b7ea-eaa190f0dab9 req-5a4004d9-24bd-47d2-bb1e-d42e35f8c834 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:09.628985 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-66d0d15a-625e-483c-b7ea-eaa190f0dab9 req-5a4004d9-24bd-47d2-bb1e-d42e35f8c834 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:09.646700 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.compute.server_external_events [req-66d0d15a-625e-483c-b7ea-eaa190f0dab9 req-5a4004d9-24bd-47d2-bb1e-d42e35f8c834 service nova] Creating event network-changed:4983815b-2774-4cc1-a815-084c70865641 for instance e5d69048-2557-4e13-92de-3381030814e6 on hv-cinder-81558 Oct 17 03:59:09.657593 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [req-66d0d15a-625e-483c-b7ea-eaa190f0dab9 req-5a4004d9-24bd-47d2-bb1e-d42e35f8c834 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071387 Oct 17 03:59:09.658913 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 417/836] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 03:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:59:10.113709 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-b1c6af9b-6044-4a79-971d-1acb1345d26f tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:10.117729 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-b1c6af9b-6044-4a79-971d-1acb1345d26f tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] [instance: d471c80c-12be-4e18-89d6-d64601602d39] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:10.129182 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b1c6af9b-6044-4a79-971d-1acb1345d26f tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:10.150046 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b1c6af9b-6044-4a79-971d-1acb1345d26f tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:10.150833 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b1c6af9b-6044-4a79-971d-1acb1345d26f tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:10.152112 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b1c6af9b-6044-4a79-971d-1acb1345d26f tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:10.163088 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b1c6af9b-6044-4a79-971d-1acb1345d26f tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:10.169786 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b1c6af9b-6044-4a79-971d-1acb1345d26f tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:10.191101 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-29f54d4c-da0c-4b02-a6c2-7af09790597a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:10.193927 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-29f54d4c-da0c-4b02-a6c2-7af09790597a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 9777f592-2e10-475d-b716-a98d5f1c3c4d] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:10.218169 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-29f54d4c-da0c-4b02-a6c2-7af09790597a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:10.218976 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-29f54d4c-da0c-4b02-a6c2-7af09790597a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:10.219972 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-29f54d4c-da0c-4b02-a6c2-7af09790597a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:10.221603 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-29f54d4c-da0c-4b02-a6c2-7af09790597a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:10.222936 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-29f54d4c-da0c-4b02-a6c2-7af09790597a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:10.223598 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-29f54d4c-da0c-4b02-a6c2-7af09790597a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:10.466086 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-b1c6af9b-6044-4a79-971d-1acb1345d26f tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b22f27c7144a3d96f41747473fe646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0a418ceb742fdb01c98c5d58424a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:10.470084 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_cell1:SELECT=100 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:59:10.474925 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-b1c6af9b-6044-4a79-971d-1acb1345d26f tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] 10.222.0.16 "GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39" status: 200 len: 1567 microversion: 2.1 time: 0.379328 Oct 17 03:59:10.475537 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 420/837] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:59:10 2022] GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39 => generated 1567 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:59:10.496428 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-29f54d4c-da0c-4b02-a6c2-7af09790597a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:10.504195 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-d6e4dc96-b5ed-4d36-ad68-99abd98443e9 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:59:10.505069 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-d6e4dc96-b5ed-4d36-ad68-99abd98443e9 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] [instance: d471c80c-12be-4e18-89d6-d64601602d39] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:10.510301 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-29f54d4c-da0c-4b02-a6c2-7af09790597a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/9777f592-2e10-475d-b716-a98d5f1c3c4d" status: 200 len: 1368 microversion: 2.1 time: 0.328488 Oct 17 03:59:10.519036 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d6e4dc96-b5ed-4d36-ad68-99abd98443e9 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:10.519890 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d6e4dc96-b5ed-4d36-ad68-99abd98443e9 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:10.520541 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d6e4dc96-b5ed-4d36-ad68-99abd98443e9 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:10.521512 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d6e4dc96-b5ed-4d36-ad68-99abd98443e9 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:10.522537 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d6e4dc96-b5ed-4d36-ad68-99abd98443e9 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:10.523144 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d6e4dc96-b5ed-4d36-ad68-99abd98443e9 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:10.533438 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 418/838] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:59:10 2022] GET /compute/v2.1/servers/9777f592-2e10-475d-b716-a98d5f1c3c4d => generated 1368 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:59:10.570446 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-d6e4dc96-b5ed-4d36-ad68-99abd98443e9 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] [instance: d471c80c-12be-4e18-89d6-d64601602d39] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=125871) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 17 03:59:11.077101 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-d6e4dc96-b5ed-4d36-ad68-99abd98443e9 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] 10.222.0.16 "POST /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39/action" status: 202 len: 0 microversion: 2.1 time: 0.576139 Oct 17 03:59:11.081181 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 421/839] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 17 03:59:10 2022] POST /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39/action => generated 0 bytes in 581 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 03:59:11.086313 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-11251ce3-3a23-467e-bb10-2e508d3684e8 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:11.086929 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-11251ce3-3a23-467e-bb10-2e508d3684e8 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] [instance: d471c80c-12be-4e18-89d6-d64601602d39] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:11.093861 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-11251ce3-3a23-467e-bb10-2e508d3684e8 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:11.094351 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-11251ce3-3a23-467e-bb10-2e508d3684e8 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:11.095280 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-11251ce3-3a23-467e-bb10-2e508d3684e8 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:11.096720 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-11251ce3-3a23-467e-bb10-2e508d3684e8 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:11.097338 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-11251ce3-3a23-467e-bb10-2e508d3684e8 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:11.098842 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-11251ce3-3a23-467e-bb10-2e508d3684e8 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:11.535616 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-247e8f32-93e5-46b9-b73a-c727de4462d5 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:11.536890 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-247e8f32-93e5-46b9-b73a-c727de4462d5 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 9777f592-2e10-475d-b716-a98d5f1c3c4d] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:11.543879 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-247e8f32-93e5-46b9-b73a-c727de4462d5 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:11.544684 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-247e8f32-93e5-46b9-b73a-c727de4462d5 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:11.545339 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-247e8f32-93e5-46b9-b73a-c727de4462d5 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:11.546278 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-247e8f32-93e5-46b9-b73a-c727de4462d5 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:11.546931 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-247e8f32-93e5-46b9-b73a-c727de4462d5 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:11.547617 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-247e8f32-93e5-46b9-b73a-c727de4462d5 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:11.734599 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-247e8f32-93e5-46b9-b73a-c727de4462d5 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:11.759456 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-247e8f32-93e5-46b9-b73a-c727de4462d5 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/9777f592-2e10-475d-b716-a98d5f1c3c4d" status: 200 len: 1368 microversion: 2.1 time: 0.228331 Oct 17 03:59:11.760248 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 422/840] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:59:11 2022] GET /compute/v2.1/servers/9777f592-2e10-475d-b716-a98d5f1c3c4d => generated 1368 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:59:11.766573 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [req-f5bcf193-e96e-4c09-9741-0922713b82d3 req-b9f4b73f-6bc9-45bb-bbdd-16a5d45a9fa0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9777f592-2e10-475d-b716-a98d5f1c3c4d", "tag": "b0a9dc4c-de2f-487a-acd6-cca8d9d40807"}]} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:59:11.779118 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-f5bcf193-e96e-4c09-9741-0922713b82d3 req-b9f4b73f-6bc9-45bb-bbdd-16a5d45a9fa0 service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:11.781003 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-f5bcf193-e96e-4c09-9741-0922713b82d3 req-b9f4b73f-6bc9-45bb-bbdd-16a5d45a9fa0 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:11.782563 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-f5bcf193-e96e-4c09-9741-0922713b82d3 req-b9f4b73f-6bc9-45bb-bbdd-16a5d45a9fa0 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:11.796265 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.compute.server_external_events [req-f5bcf193-e96e-4c09-9741-0922713b82d3 req-b9f4b73f-6bc9-45bb-bbdd-16a5d45a9fa0 service nova] Creating event network-changed:b0a9dc4c-de2f-487a-acd6-cca8d9d40807 for instance 9777f592-2e10-475d-b716-a98d5f1c3c4d on hv-cinder-81558 Oct 17 03:59:11.811526 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [req-f5bcf193-e96e-4c09-9741-0922713b82d3 req-b9f4b73f-6bc9-45bb-bbdd-16a5d45a9fa0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049287 Oct 17 03:59:11.812550 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 423/841] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 03:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:59:11.845612 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-11251ce3-3a23-467e-bb10-2e508d3684e8 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b22f27c7144a3d96f41747473fe646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0a418ceb742fdb01c98c5d58424a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:11.848718 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:59:11.855952 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-11251ce3-3a23-467e-bb10-2e508d3684e8 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] 10.222.0.16 "GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39" status: 200 len: 1515 microversion: 2.1 time: 0.773629 Oct 17 03:59:11.857471 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 419/842] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:59:11 2022] GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39 => generated 1515 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:59:11.897097 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [req-eefac080-309b-4041-9d2e-9565b738a8d8 req-a1d7b560-a6d1-4cc1-819a-0fc4763878e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d471c80c-12be-4e18-89d6-d64601602d39", "name": "network-vif-unplugged", "status": "completed", "tag": "63565771-2da1-4fe4-a238-2f393636b21d"}]} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:59:11.908685 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-eefac080-309b-4041-9d2e-9565b738a8d8 req-a1d7b560-a6d1-4cc1-819a-0fc4763878e0 service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:11.909247 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-eefac080-309b-4041-9d2e-9565b738a8d8 req-a1d7b560-a6d1-4cc1-819a-0fc4763878e0 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:11.909752 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-eefac080-309b-4041-9d2e-9565b738a8d8 req-a1d7b560-a6d1-4cc1-819a-0fc4763878e0 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:11.922127 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.compute.server_external_events [req-eefac080-309b-4041-9d2e-9565b738a8d8 req-a1d7b560-a6d1-4cc1-819a-0fc4763878e0 service nova] Unable to find a host for instance d471c80c-12be-4e18-89d6-d64601602d39. Dropping event network-vif-unplugged {{(pid=125871) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 17 03:59:11.923109 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [req-eefac080-309b-4041-9d2e-9565b738a8d8 req-a1d7b560-a6d1-4cc1-819a-0fc4763878e0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033776 Oct 17 03:59:11.923740 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 424/843] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 03:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 17 03:59:12.788465 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-c921fd09-a7d8-4ab8-a016-dbab80da0e7f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:12.789076 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-c921fd09-a7d8-4ab8-a016-dbab80da0e7f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 9777f592-2e10-475d-b716-a98d5f1c3c4d] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:12.795719 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c921fd09-a7d8-4ab8-a016-dbab80da0e7f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:12.796193 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c921fd09-a7d8-4ab8-a016-dbab80da0e7f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:12.796626 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c921fd09-a7d8-4ab8-a016-dbab80da0e7f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:12.797300 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c921fd09-a7d8-4ab8-a016-dbab80da0e7f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:12.797750 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c921fd09-a7d8-4ab8-a016-dbab80da0e7f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:12.798173 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c921fd09-a7d8-4ab8-a016-dbab80da0e7f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:12.833625 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_cell0:SELECT=2 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:59:12.854522 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_cell0:SELECT=18 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:59:12.881863 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-931c2c73-26c9-4486-9b74-7f6be0313bda tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:12.882753 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-931c2c73-26c9-4486-9b74-7f6be0313bda tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] [instance: d471c80c-12be-4e18-89d6-d64601602d39] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:12.891449 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-931c2c73-26c9-4486-9b74-7f6be0313bda tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:12.893904 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-931c2c73-26c9-4486-9b74-7f6be0313bda tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:12.893904 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-931c2c73-26c9-4486-9b74-7f6be0313bda tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:12.893904 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-931c2c73-26c9-4486-9b74-7f6be0313bda tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:12.893904 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-931c2c73-26c9-4486-9b74-7f6be0313bda tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:12.894373 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-931c2c73-26c9-4486-9b74-7f6be0313bda tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:12.941087 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-c921fd09-a7d8-4ab8-a016-dbab80da0e7f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:12.955253 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-c921fd09-a7d8-4ab8-a016-dbab80da0e7f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/9777f592-2e10-475d-b716-a98d5f1c3c4d" status: 200 len: 1368 microversion: 2.1 time: 0.170852 Oct 17 03:59:12.955850 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 420/844] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:59:12 2022] GET /compute/v2.1/servers/9777f592-2e10-475d-b716-a98d5f1c3c4d => generated 1368 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:59:13.056102 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-931c2c73-26c9-4486-9b74-7f6be0313bda tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b22f27c7144a3d96f41747473fe646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0a418ceb742fdb01c98c5d58424a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:13.064646 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-931c2c73-26c9-4486-9b74-7f6be0313bda tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] 10.222.0.16 "GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39" status: 200 len: 1515 microversion: 2.1 time: 0.187742 Oct 17 03:59:13.065292 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 425/845] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:59:12 2022] GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39 => generated 1515 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:59:13.977189 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-e69c9388-99ae-4086-bf09-85bd9793e6f0 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:13.977812 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-e69c9388-99ae-4086-bf09-85bd9793e6f0 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 9777f592-2e10-475d-b716-a98d5f1c3c4d] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:13.984639 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e69c9388-99ae-4086-bf09-85bd9793e6f0 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:13.985210 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e69c9388-99ae-4086-bf09-85bd9793e6f0 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:13.985545 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e69c9388-99ae-4086-bf09-85bd9793e6f0 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:13.986249 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e69c9388-99ae-4086-bf09-85bd9793e6f0 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:13.986753 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e69c9388-99ae-4086-bf09-85bd9793e6f0 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:13.987126 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e69c9388-99ae-4086-bf09-85bd9793e6f0 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:14.088053 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-579cf867-e2a1-4eac-bd69-499c252c2d9e tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:14.089454 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-579cf867-e2a1-4eac-bd69-499c252c2d9e tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] [instance: d471c80c-12be-4e18-89d6-d64601602d39] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:14.098451 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_cell0:SELECT=2 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:59:14.102166 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-579cf867-e2a1-4eac-bd69-499c252c2d9e tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:14.103925 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-579cf867-e2a1-4eac-bd69-499c252c2d9e tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:14.107253 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-579cf867-e2a1-4eac-bd69-499c252c2d9e tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:14.108104 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-579cf867-e2a1-4eac-bd69-499c252c2d9e tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:14.108820 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-579cf867-e2a1-4eac-bd69-499c252c2d9e tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:14.109253 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-579cf867-e2a1-4eac-bd69-499c252c2d9e tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:14.128407 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-e69c9388-99ae-4086-bf09-85bd9793e6f0 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:14.137487 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-e69c9388-99ae-4086-bf09-85bd9793e6f0 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/9777f592-2e10-475d-b716-a98d5f1c3c4d" status: 200 len: 1368 microversion: 2.1 time: 0.164429 Oct 17 03:59:14.139429 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 421/846] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:59:13 2022] GET /compute/v2.1/servers/9777f592-2e10-475d-b716-a98d5f1c3c4d => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:59:14.281308 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-579cf867-e2a1-4eac-bd69-499c252c2d9e tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b22f27c7144a3d96f41747473fe646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0a418ceb742fdb01c98c5d58424a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:14.288995 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-579cf867-e2a1-4eac-bd69-499c252c2d9e tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] 10.222.0.16 "GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39" status: 200 len: 1517 microversion: 2.1 time: 0.204997 Oct 17 03:59:14.289597 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 426/847] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:59:14 2022] GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39 => generated 1517 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:59:14.744099 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-1c422dc3-ab7b-469c-aa17-38c61ed02b75 tempest-VolumesGetTestJSON-478229719 tempest-VolumesGetTestJSON-478229719-project] Action: 'create', calling method: .version_select at 0x7fd72a547ee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-316275569", "metadata": {"Type": "work"}}} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:59:15.161423 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-79b81238-8814-4520-a607-611db5cbfe8a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:15.162039 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-79b81238-8814-4520-a607-611db5cbfe8a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 9777f592-2e10-475d-b716-a98d5f1c3c4d] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:15.169156 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-79b81238-8814-4520-a607-611db5cbfe8a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:15.169646 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-79b81238-8814-4520-a607-611db5cbfe8a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:15.170762 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-79b81238-8814-4520-a607-611db5cbfe8a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:15.171534 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-79b81238-8814-4520-a607-611db5cbfe8a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:15.171994 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-79b81238-8814-4520-a607-611db5cbfe8a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:15.172420 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-79b81238-8814-4520-a607-611db5cbfe8a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:15.310236 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-79b81238-8814-4520-a607-611db5cbfe8a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:15.315438 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-79b81238-8814-4520-a607-611db5cbfe8a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/9777f592-2e10-475d-b716-a98d5f1c3c4d" status: 200 len: 1368 microversion: 2.1 time: 0.157752 Oct 17 03:59:15.338285 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 427/848] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:59:15 2022] GET /compute/v2.1/servers/9777f592-2e10-475d-b716-a98d5f1c3c4d => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:59:15.338285 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-0961cc74-f1d5-4a1a-a58a-c10111167d3f tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:15.338285 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-0961cc74-f1d5-4a1a-a58a-c10111167d3f tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] [instance: d471c80c-12be-4e18-89d6-d64601602d39] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:15.338285 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0961cc74-f1d5-4a1a-a58a-c10111167d3f tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:15.338285 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0961cc74-f1d5-4a1a-a58a-c10111167d3f tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:15.339765 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0961cc74-f1d5-4a1a-a58a-c10111167d3f tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:15.339765 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0961cc74-f1d5-4a1a-a58a-c10111167d3f tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:15.339765 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0961cc74-f1d5-4a1a-a58a-c10111167d3f tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:15.339765 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0961cc74-f1d5-4a1a-a58a-c10111167d3f tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:15.388712 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-1c422dc3-ab7b-469c-aa17-38c61ed02b75 tempest-VolumesGetTestJSON-478229719 tempest-VolumesGetTestJSON-478229719-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.756058 Oct 17 03:59:15.391661 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 422/849] 10.222.0.16 () {60 vars in 1156 bytes} [Mon Oct 17 03:59:14 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 760 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 17 03:59:15.404231 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-9af61e9b-aedf-4147-aefe-cf7f54937601 tempest-VolumesGetTestJSON-478229719 tempest-VolumesGetTestJSON-478229719-project] Calling method '.version_select at 0x7fd72a625b80>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:15.458009 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-9af61e9b-aedf-4147-aefe-cf7f54937601 tempest-VolumesGetTestJSON-478229719 tempest-VolumesGetTestJSON-478229719-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/b1faf819-b6d4-491f-9d37-c5d44cd5103d" status: 200 len: 352 microversion: 2.1 time: 0.057490 Oct 17 03:59:15.458805 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 423/850] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Oct 17 03:59:15 2022] GET /compute/v2.1/os-volumes/b1faf819-b6d4-491f-9d37-c5d44cd5103d => generated 352 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:59:15.499815 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-0961cc74-f1d5-4a1a-a58a-c10111167d3f tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b22f27c7144a3d96f41747473fe646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0a418ceb742fdb01c98c5d58424a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:15.507587 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-0961cc74-f1d5-4a1a-a58a-c10111167d3f tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] 10.222.0.16 "GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39" status: 200 len: 1573 microversion: 2.1 time: 0.190039 Oct 17 03:59:15.508164 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 428/851] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:59:15 2022] GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39 => generated 1573 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:59:15.807765 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [req-eadd6412-f99f-46d3-8459-ff8ee31848f3 req-4903312e-80cb-4aee-8bf6-dbfc574107af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9777f592-2e10-475d-b716-a98d5f1c3c4d", "name": "network-vif-plugged", "status": "completed", "tag": "b0a9dc4c-de2f-487a-acd6-cca8d9d40807"}]} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:59:15.818211 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-eadd6412-f99f-46d3-8459-ff8ee31848f3 req-4903312e-80cb-4aee-8bf6-dbfc574107af service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:15.818681 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-eadd6412-f99f-46d3-8459-ff8ee31848f3 req-4903312e-80cb-4aee-8bf6-dbfc574107af service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:15.819103 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-eadd6412-f99f-46d3-8459-ff8ee31848f3 req-4903312e-80cb-4aee-8bf6-dbfc574107af service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:15.829706 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.compute.server_external_events [req-eadd6412-f99f-46d3-8459-ff8ee31848f3 req-4903312e-80cb-4aee-8bf6-dbfc574107af service nova] Creating event network-vif-plugged:b0a9dc4c-de2f-487a-acd6-cca8d9d40807 for instance 9777f592-2e10-475d-b716-a98d5f1c3c4d on hv-cinder-81558 Oct 17 03:59:15.834418 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [req-eadd6412-f99f-46d3-8459-ff8ee31848f3 req-4903312e-80cb-4aee-8bf6-dbfc574107af service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030792 Oct 17 03:59:15.834999 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 424/852] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 03:59:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:59:16.339915 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-0688be90-eb2d-464b-ae31-803df810565f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:16.340568 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-0688be90-eb2d-464b-ae31-803df810565f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 9777f592-2e10-475d-b716-a98d5f1c3c4d] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:16.346883 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0688be90-eb2d-464b-ae31-803df810565f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:16.347460 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0688be90-eb2d-464b-ae31-803df810565f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:16.347887 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0688be90-eb2d-464b-ae31-803df810565f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:16.348567 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0688be90-eb2d-464b-ae31-803df810565f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:16.349015 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0688be90-eb2d-464b-ae31-803df810565f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:16.349432 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0688be90-eb2d-464b-ae31-803df810565f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:16.473619 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-86133ccd-2c77-4573-a0ed-3172befa0eab tempest-VolumesGetTestJSON-478229719 tempest-VolumesGetTestJSON-478229719-project] Calling method '.version_select at 0x7fd72a50b8b0>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:16.487906 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-0688be90-eb2d-464b-ae31-803df810565f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:16.491521 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-0688be90-eb2d-464b-ae31-803df810565f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/9777f592-2e10-475d-b716-a98d5f1c3c4d" status: 200 len: 1368 microversion: 2.1 time: 0.155427 Oct 17 03:59:16.492102 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 429/853] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:59:16 2022] GET /compute/v2.1/servers/9777f592-2e10-475d-b716-a98d5f1c3c4d => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:59:16.521831 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-86133ccd-2c77-4573-a0ed-3172befa0eab tempest-VolumesGetTestJSON-478229719 tempest-VolumesGetTestJSON-478229719-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/b1faf819-b6d4-491f-9d37-c5d44cd5103d" status: 200 len: 353 microversion: 2.1 time: 0.052269 Oct 17 03:59:16.522402 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 425/854] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Oct 17 03:59:16 2022] GET /compute/v2.1/os-volumes/b1faf819-b6d4-491f-9d37-c5d44cd5103d => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 03:59:16.531980 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-13c10b43-1bf2-432b-9bc5-a991e9438c4c tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:16.532591 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-13c10b43-1bf2-432b-9bc5-a991e9438c4c tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] [instance: d471c80c-12be-4e18-89d6-d64601602d39] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:16.536623 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-b743287d-9b06-4723-bc97-1042f161165c tempest-VolumesGetTestJSON-478229719 tempest-VolumesGetTestJSON-478229719-project] Calling method '.version_select at 0x7fd72a5473a0>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:16.538677 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-13c10b43-1bf2-432b-9bc5-a991e9438c4c tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:16.539154 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-13c10b43-1bf2-432b-9bc5-a991e9438c4c tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:16.539610 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-13c10b43-1bf2-432b-9bc5-a991e9438c4c tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:16.540294 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-13c10b43-1bf2-432b-9bc5-a991e9438c4c tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:16.540744 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-13c10b43-1bf2-432b-9bc5-a991e9438c4c tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:16.541166 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-13c10b43-1bf2-432b-9bc5-a991e9438c4c tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:16.584993 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-b743287d-9b06-4723-bc97-1042f161165c tempest-VolumesGetTestJSON-478229719 tempest-VolumesGetTestJSON-478229719-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/b1faf819-b6d4-491f-9d37-c5d44cd5103d" status: 200 len: 353 microversion: 2.1 time: 0.053161 Oct 17 03:59:16.585574 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 426/855] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Oct 17 03:59:16 2022] GET /compute/v2.1/os-volumes/b1faf819-b6d4-491f-9d37-c5d44cd5103d => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 03:59:16.608370 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-7fb85931-11cd-4796-bc78-8cb26b1d9a3e tempest-VolumesGetTestJSON-478229719 tempest-VolumesGetTestJSON-478229719-project] Calling method '.version_select at 0x7fd72a547280>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:16.677439 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-13c10b43-1bf2-432b-9bc5-a991e9438c4c tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b22f27c7144a3d96f41747473fe646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0a418ceb742fdb01c98c5d58424a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:16.685235 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-13c10b43-1bf2-432b-9bc5-a991e9438c4c tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] 10.222.0.16 "GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39" status: 200 len: 1573 microversion: 2.1 time: 0.157800 Oct 17 03:59:16.696955 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 430/856] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:59:16 2022] GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39 => generated 1573 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:59:16.861840 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-7fb85931-11cd-4796-bc78-8cb26b1d9a3e tempest-VolumesGetTestJSON-478229719 tempest-VolumesGetTestJSON-478229719-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/b1faf819-b6d4-491f-9d37-c5d44cd5103d" status: 202 len: 0 microversion: 2.1 time: 0.261585 Oct 17 03:59:16.862461 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 427/857] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Oct 17 03:59:16 2022] DELETE /compute/v2.1/os-volumes/b1faf819-b6d4-491f-9d37-c5d44cd5103d => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 03:59:16.870638 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-40917e2a-914e-42f4-b4a3-a6b1eb1753c9 tempest-VolumesGetTestJSON-478229719 tempest-VolumesGetTestJSON-478229719-project] Calling method '.version_select at 0x7fd72a6ca430>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:16.918965 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-40917e2a-914e-42f4-b4a3-a6b1eb1753c9 tempest-VolumesGetTestJSON-478229719 tempest-VolumesGetTestJSON-478229719-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/b1faf819-b6d4-491f-9d37-c5d44cd5103d" status: 200 len: 352 microversion: 2.1 time: 0.052200 Oct 17 03:59:16.919563 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 431/858] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Oct 17 03:59:16 2022] GET /compute/v2.1/os-volumes/b1faf819-b6d4-491f-9d37-c5d44cd5103d => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 03:59:17.514520 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-fb3f1933-ca24-4dbe-b45a-face6a0676cd tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:17.515305 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-fb3f1933-ca24-4dbe-b45a-face6a0676cd tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 9777f592-2e10-475d-b716-a98d5f1c3c4d] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:17.521553 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-fb3f1933-ca24-4dbe-b45a-face6a0676cd tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:17.522047 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-fb3f1933-ca24-4dbe-b45a-face6a0676cd tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:17.522468 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-fb3f1933-ca24-4dbe-b45a-face6a0676cd tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:17.523154 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-fb3f1933-ca24-4dbe-b45a-face6a0676cd tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:17.523627 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-fb3f1933-ca24-4dbe-b45a-face6a0676cd tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:17.524049 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-fb3f1933-ca24-4dbe-b45a-face6a0676cd tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:17.654078 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-fb3f1933-ca24-4dbe-b45a-face6a0676cd tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:17.662541 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-fb3f1933-ca24-4dbe-b45a-face6a0676cd tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/9777f592-2e10-475d-b716-a98d5f1c3c4d" status: 200 len: 1368 microversion: 2.1 time: 0.152759 Oct 17 03:59:17.663107 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 428/859] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:59:17 2022] GET /compute/v2.1/servers/9777f592-2e10-475d-b716-a98d5f1c3c4d => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:59:17.709591 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-0281df8a-3d3a-4dca-95aa-6f08796c7cf0 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:17.710202 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-0281df8a-3d3a-4dca-95aa-6f08796c7cf0 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] [instance: d471c80c-12be-4e18-89d6-d64601602d39] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:17.716392 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0281df8a-3d3a-4dca-95aa-6f08796c7cf0 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:17.716886 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0281df8a-3d3a-4dca-95aa-6f08796c7cf0 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:17.717317 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0281df8a-3d3a-4dca-95aa-6f08796c7cf0 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:17.718001 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0281df8a-3d3a-4dca-95aa-6f08796c7cf0 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:17.718450 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0281df8a-3d3a-4dca-95aa-6f08796c7cf0 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:17.718869 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0281df8a-3d3a-4dca-95aa-6f08796c7cf0 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:17.856299 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-0281df8a-3d3a-4dca-95aa-6f08796c7cf0 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b22f27c7144a3d96f41747473fe646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0a418ceb742fdb01c98c5d58424a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:17.864814 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-0281df8a-3d3a-4dca-95aa-6f08796c7cf0 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] 10.222.0.16 "GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39" status: 200 len: 1573 microversion: 2.1 time: 0.159744 Oct 17 03:59:17.865475 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 432/860] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:59:17 2022] GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39 => generated 1573 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:59:17.932916 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-813b7526-8106-4e51-a39d-3cf45e815525 tempest-VolumesGetTestJSON-478229719 tempest-VolumesGetTestJSON-478229719-project] Calling method '.version_select at 0x7fd72a50b8b0>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:17.961028 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.wsgi [None req-813b7526-8106-4e51-a39d-3cf45e815525 tempest-VolumesGetTestJSON-478229719 tempest-VolumesGetTestJSON-478229719-project] HTTP exception thrown: Volume b1faf819-b6d4-491f-9d37-c5d44cd5103d could not be found. Oct 17 03:59:17.962896 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-813b7526-8106-4e51-a39d-3cf45e815525 tempest-VolumesGetTestJSON-478229719 tempest-VolumesGetTestJSON-478229719-project] Request method failure captured: Oct 17 03:59:17.962896 dv-cinder-815582-16-smb devstack@n-api.service[125872]: request: GET /compute/v2.1/os-volumes/b1faf819-b6d4-491f-9d37-c5d44cd5103d HTTP/1.1 Oct 17 03:59:17.962896 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Accept: application/json Oct 17 03:59:17.962896 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Accept-Encoding: identity Oct 17 03:59:17.962896 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Connection: close Oct 17 03:59:17.962896 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Content-Length: 0 Oct 17 03:59:17.962896 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Content-Type: application/json Oct 17 03:59:17.962896 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Host: 10.222.0.16 Oct 17 03:59:17.962896 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Openstack-System-Scope: None Oct 17 03:59:17.962896 dv-cinder-815582-16-smb devstack@n-api.service[125872]: User-Agent: python-urllib3/1.26.12 Oct 17 03:59:17.962896 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Auth-Token: gAAAAABjTNMSA_L7cosMTdVEqASoj22boDKCwUoSEMO95hMgttnwytEXwtMnuPfsekAcPzL0G4rXJ_P-PYIWdAiGM6vFho0geQQH_hVQqngHaAK3CYlaZVkay74vTlphL_Ibbhk7J6ZZqxv1KNCXJj-XH9Tx2yGSdfykjsOZiM5DdzfSngHqsAM Oct 17 03:59:17.962896 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Domain-Id: None Oct 17 03:59:17.962896 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Domain-Name: None Oct 17 03:59:17.962896 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Identity-Status: Confirmed Oct 17 03:59:17.962896 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Is-Admin-Project: True Oct 17 03:59:17.962896 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Domain-Id: default Oct 17 03:59:17.962896 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Domain-Name: Default Oct 17 03:59:17.962896 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Id: b3891c89a76047d5bf8250e4abf40af5 Oct 17 03:59:17.962896 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Name: tempest-VolumesGetTestJSON-478229719 Oct 17 03:59:17.962896 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Role: reader,member Oct 17 03:59:17.962896 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Roles: reader,member Oct 17 03:59:17.964615 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b3891c89a76047d5bf8250e4abf40af5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b3891c89a76047d5bf8250e4abf40af5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b3891c89a76047d5bf8250e4abf40af5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b3891c89a76047d5bf8250e4abf40af5", "adminURL": "http://10.222.0.16:8080"}]}] Oct 17 03:59:17.964615 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant: tempest-VolumesGetTestJSON-478229719 Oct 17 03:59:17.964615 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant-Id: b3891c89a76047d5bf8250e4abf40af5 Oct 17 03:59:17.964615 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant-Name: tempest-VolumesGetTestJSON-478229719 Oct 17 03:59:17.964615 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User: tempest-VolumesGetTestJSON-478229719-project Oct 17 03:59:17.964615 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Domain-Id: default Oct 17 03:59:17.964615 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Domain-Name: Default Oct 17 03:59:17.964615 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Id: e4ecc772256d4a99b59272249f26819d Oct 17 03:59:17.964615 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Name: tempest-VolumesGetTestJSON-478229719-project Oct 17 03:59:17.964615 dv-cinder-815582-16-smb devstack@n-api.service[125872]: method: Oct 17 03:59:17.964615 dv-cinder-815582-16-smb devstack@n-api.service[125872]: exception: Volume b1faf819-b6d4-491f-9d37-c5d44cd5103d could not be found. Oct 17 03:59:17.964615 dv-cinder-815582-16-smb devstack@n-api.service[125872]: action_args: {'id': 'b1faf819-b6d4-491f-9d37-c5d44cd5103d'} Oct 17 03:59:17.964615 dv-cinder-815582-16-smb devstack@n-api.service[125872]: {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:59:17.965710 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:59:17.965710 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 03:59:17.965710 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 03:59:17.965710 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 03:59:17.965710 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 03:59:17.965710 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 03:59:17.965710 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 03:59:17.965710 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 03:59:17.965710 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 03:59:17.965710 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 03:59:17.965710 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 03:59:17.965710 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 03:59:17.965710 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 03:59:17.965710 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 03:59:17.965710 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 03:59:17.965710 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b1faf819-b6d4-491f-9d37-c5d44cd5103d could not be found. (HTTP 404) (Request-ID: req-6c2ee9a5-4daf-4160-945d-871f6bfd8568) Oct 17 03:59:17.965710 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:59:17.965710 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:59:17.965710 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:59:17.967872 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:59:17.967872 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 17 03:59:17.967872 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 17 03:59:17.967872 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 03:59:17.967872 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 03:59:17.967872 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 03:59:17.967872 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 03:59:17.967872 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 03:59:17.967872 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 03:59:17.967872 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 03:59:17.967872 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 03:59:17.967872 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 03:59:17.967872 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 03:59:17.967872 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 03:59:17.967872 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 03:59:17.967872 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 03:59:17.967872 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 03:59:17.967872 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 03:59:17.967872 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 03:59:17.969268 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 03:59:17.969268 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 03:59:17.969268 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 03:59:17.969268 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 03:59:17.969268 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b1faf819-b6d4-491f-9d37-c5d44cd5103d could not be found. Oct 17 03:59:17.969268 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:59:17.969268 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:59:17.969268 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:59:17.969268 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:59:17.969268 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:59:17.969268 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:59:17.969268 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:59:17.969268 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:59:17.969268 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 03:59:17.969268 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 03:59:17.969268 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:59:17.969268 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:59:17.969268 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 17 03:59:17.969268 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:59:17.970752 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b1faf819-b6d4-491f-9d37-c5d44cd5103d could not be found. Oct 17 03:59:17.970752 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:59:17.970752 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:59:17.970752 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:59:17.970752 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:59:17.970752 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:59:17.970752 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:59:17.970752 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:59:17.970752 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:59:17.970752 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b1faf819-b6d4-491f-9d37-c5d44cd5103d could not be found. Oct 17 03:59:17.970752 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:59:17.970752 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-813b7526-8106-4e51-a39d-3cf45e815525 tempest-VolumesGetTestJSON-478229719 tempest-VolumesGetTestJSON-478229719-project] Returning 404 to user: Volume b1faf819-b6d4-491f-9d37-c5d44cd5103d could not be found. {{(pid=125872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:59:17.970752 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-813b7526-8106-4e51-a39d-3cf45e815525 tempest-VolumesGetTestJSON-478229719 tempest-VolumesGetTestJSON-478229719-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/b1faf819-b6d4-491f-9d37-c5d44cd5103d" status: 404 len: 109 microversion: 2.1 time: 0.035254 Oct 17 03:59:17.970752 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 429/861] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Oct 17 03:59:17 2022] GET /compute/v2.1/os-volumes/b1faf819-b6d4-491f-9d37-c5d44cd5103d => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 03:59:18.685664 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-04a62a12-9ed2-44d6-ba2f-7af487c6478a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:18.686349 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-04a62a12-9ed2-44d6-ba2f-7af487c6478a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 9777f592-2e10-475d-b716-a98d5f1c3c4d] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:18.692647 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-04a62a12-9ed2-44d6-ba2f-7af487c6478a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:18.693132 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-04a62a12-9ed2-44d6-ba2f-7af487c6478a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:18.693568 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-04a62a12-9ed2-44d6-ba2f-7af487c6478a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:18.694351 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-04a62a12-9ed2-44d6-ba2f-7af487c6478a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:18.694810 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-04a62a12-9ed2-44d6-ba2f-7af487c6478a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:18.695262 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-04a62a12-9ed2-44d6-ba2f-7af487c6478a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:18.832419 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-04a62a12-9ed2-44d6-ba2f-7af487c6478a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:18.840252 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-04a62a12-9ed2-44d6-ba2f-7af487c6478a tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/9777f592-2e10-475d-b716-a98d5f1c3c4d" status: 200 len: 1559 microversion: 2.1 time: 0.158588 Oct 17 03:59:18.840830 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 433/862] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:59:18 2022] GET /compute/v2.1/servers/9777f592-2e10-475d-b716-a98d5f1c3c4d => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:59:18.863231 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-c8b1c406-a903-46c0-8612-c5305bcecaa2 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:18.863771 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-c8b1c406-a903-46c0-8612-c5305bcecaa2 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 9777f592-2e10-475d-b716-a98d5f1c3c4d] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:18.870516 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c8b1c406-a903-46c0-8612-c5305bcecaa2 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:18.871003 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c8b1c406-a903-46c0-8612-c5305bcecaa2 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:18.871470 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c8b1c406-a903-46c0-8612-c5305bcecaa2 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:18.872170 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c8b1c406-a903-46c0-8612-c5305bcecaa2 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:18.872630 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c8b1c406-a903-46c0-8612-c5305bcecaa2 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:18.873056 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c8b1c406-a903-46c0-8612-c5305bcecaa2 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:18.889628 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-65548946-6193-4107-a24d-ded7068c804a tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:18.890266 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-65548946-6193-4107-a24d-ded7068c804a tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] [instance: d471c80c-12be-4e18-89d6-d64601602d39] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:18.896171 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-65548946-6193-4107-a24d-ded7068c804a tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:18.896661 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-65548946-6193-4107-a24d-ded7068c804a tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:18.897098 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-65548946-6193-4107-a24d-ded7068c804a tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:18.899538 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-65548946-6193-4107-a24d-ded7068c804a tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:18.899538 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-65548946-6193-4107-a24d-ded7068c804a tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:18.899538 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-65548946-6193-4107-a24d-ded7068c804a tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:18.969906 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-c8b1c406-a903-46c0-8612-c5305bcecaa2 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/9777f592-2e10-475d-b716-a98d5f1c3c4d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.110636 Oct 17 03:59:18.970501 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 430/863] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Oct 17 03:59:18 2022] GET /compute/v2.1/servers/9777f592-2e10-475d-b716-a98d5f1c3c4d/os-interface => generated 285 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 03:59:19.041741 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-65548946-6193-4107-a24d-ded7068c804a tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b22f27c7144a3d96f41747473fe646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0a418ceb742fdb01c98c5d58424a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:19.049618 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-65548946-6193-4107-a24d-ded7068c804a tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] 10.222.0.16 "GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39" status: 200 len: 1573 microversion: 2.1 time: 0.164747 Oct 17 03:59:19.050188 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 434/864] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:59:18 2022] GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39 => generated 1573 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:59:19.778012 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [req-9bf07395-b00a-4b98-96eb-d114a337b14b req-19b36545-8ae3-4ced-bbb1-6417849f03fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d471c80c-12be-4e18-89d6-d64601602d39", "name": "network-vif-plugged", "status": "completed", "tag": "63565771-2da1-4fe4-a238-2f393636b21d"}]} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:59:19.788570 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-9bf07395-b00a-4b98-96eb-d114a337b14b req-19b36545-8ae3-4ced-bbb1-6417849f03fc service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:19.789046 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-9bf07395-b00a-4b98-96eb-d114a337b14b req-19b36545-8ae3-4ced-bbb1-6417849f03fc service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:19.789473 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-9bf07395-b00a-4b98-96eb-d114a337b14b req-19b36545-8ae3-4ced-bbb1-6417849f03fc service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:19.961891 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.compute.server_external_events [req-9bf07395-b00a-4b98-96eb-d114a337b14b req-19b36545-8ae3-4ced-bbb1-6417849f03fc service nova] Creating event network-vif-plugged:63565771-2da1-4fe4-a238-2f393636b21d for instance d471c80c-12be-4e18-89d6-d64601602d39 on hv-cinder-81558 Oct 17 03:59:19.971112 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [req-9bf07395-b00a-4b98-96eb-d114a337b14b req-19b36545-8ae3-4ced-bbb1-6417849f03fc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.193110 Oct 17 03:59:19.971112 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 431/865] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 03:59:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:59:20.077902 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-e43def67-5459-470a-ab41-608339568fe3 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:20.078721 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-e43def67-5459-470a-ab41-608339568fe3 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] [instance: d471c80c-12be-4e18-89d6-d64601602d39] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:20.086305 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e43def67-5459-470a-ab41-608339568fe3 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:20.087006 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e43def67-5459-470a-ab41-608339568fe3 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:20.087557 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e43def67-5459-470a-ab41-608339568fe3 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:20.088439 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e43def67-5459-470a-ab41-608339568fe3 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:20.089189 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e43def67-5459-470a-ab41-608339568fe3 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:20.089777 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e43def67-5459-470a-ab41-608339568fe3 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:20.159828 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [req-f6fc422a-17cb-40fc-9819-0ac7900b2638 req-de03e1f7-5832-4614-a7d0-267996f50495 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9777f592-2e10-475d-b716-a98d5f1c3c4d", "tag": "b0a9dc4c-de2f-487a-acd6-cca8d9d40807"}]} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:59:20.169444 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-f6fc422a-17cb-40fc-9819-0ac7900b2638 req-de03e1f7-5832-4614-a7d0-267996f50495 service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:20.169919 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-f6fc422a-17cb-40fc-9819-0ac7900b2638 req-de03e1f7-5832-4614-a7d0-267996f50495 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:20.170349 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-f6fc422a-17cb-40fc-9819-0ac7900b2638 req-de03e1f7-5832-4614-a7d0-267996f50495 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:20.181658 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.compute.server_external_events [req-f6fc422a-17cb-40fc-9819-0ac7900b2638 req-de03e1f7-5832-4614-a7d0-267996f50495 service nova] Creating event network-changed:b0a9dc4c-de2f-487a-acd6-cca8d9d40807 for instance 9777f592-2e10-475d-b716-a98d5f1c3c4d on hv-cinder-81558 Oct 17 03:59:20.186609 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [req-f6fc422a-17cb-40fc-9819-0ac7900b2638 req-de03e1f7-5832-4614-a7d0-267996f50495 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.182253 Oct 17 03:59:20.187447 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 435/866] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 03:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:59:20.277167 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-e43def67-5459-470a-ab41-608339568fe3 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b22f27c7144a3d96f41747473fe646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0a418ceb742fdb01c98c5d58424a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:20.288738 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-e43def67-5459-470a-ab41-608339568fe3 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] 10.222.0.16 "GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39" status: 200 len: 1573 microversion: 2.1 time: 0.218198 Oct 17 03:59:20.290412 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 432/867] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:59:20 2022] GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39 => generated 1573 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:59:21.314244 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-89a0907e-ff8c-48d3-abe3-c13254a53030 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:21.314972 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-89a0907e-ff8c-48d3-abe3-c13254a53030 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] [instance: d471c80c-12be-4e18-89d6-d64601602d39] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:21.321046 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-89a0907e-ff8c-48d3-abe3-c13254a53030 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:21.321533 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-89a0907e-ff8c-48d3-abe3-c13254a53030 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:21.321969 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-89a0907e-ff8c-48d3-abe3-c13254a53030 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:21.322662 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-89a0907e-ff8c-48d3-abe3-c13254a53030 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:21.323116 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-89a0907e-ff8c-48d3-abe3-c13254a53030 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:21.323614 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-89a0907e-ff8c-48d3-abe3-c13254a53030 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:21.462958 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-89a0907e-ff8c-48d3-abe3-c13254a53030 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b22f27c7144a3d96f41747473fe646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0a418ceb742fdb01c98c5d58424a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:21.471436 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-89a0907e-ff8c-48d3-abe3-c13254a53030 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] 10.222.0.16 "GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39" status: 200 len: 1573 microversion: 2.1 time: 0.161907 Oct 17 03:59:21.471991 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 436/868] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:59:21 2022] GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39 => generated 1573 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:59:21.870900 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-3e9c80da-8836-4b65-9bb7-3b308284c110 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:21.871453 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-3e9c80da-8836-4b65-9bb7-3b308284c110 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: 53df9edf-f0ce-44bd-82fb-378d51d91e67] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:21.878461 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-3e9c80da-8836-4b65-9bb7-3b308284c110 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:21.879032 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-3e9c80da-8836-4b65-9bb7-3b308284c110 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:21.879595 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-3e9c80da-8836-4b65-9bb7-3b308284c110 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:21.880594 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-3e9c80da-8836-4b65-9bb7-3b308284c110 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:21.881123 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-3e9c80da-8836-4b65-9bb7-3b308284c110 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:21.881624 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-3e9c80da-8836-4b65-9bb7-3b308284c110 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:21.906984 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-3e9c80da-8836-4b65-9bb7-3b308284c110 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67/ips" status: 200 len: 145 microversion: 2.1 time: 0.204078 Oct 17 03:59:21.907494 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 433/869] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Oct 17 03:59:21 2022] GET /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67/ips => generated 145 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:59:22.493816 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-8d2344e4-3c5e-4e41-a595-d61e87372db5 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:22.494432 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-8d2344e4-3c5e-4e41-a595-d61e87372db5 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] [instance: d471c80c-12be-4e18-89d6-d64601602d39] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:22.501068 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8d2344e4-3c5e-4e41-a595-d61e87372db5 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:22.501550 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8d2344e4-3c5e-4e41-a595-d61e87372db5 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:22.501987 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8d2344e4-3c5e-4e41-a595-d61e87372db5 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:22.502679 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8d2344e4-3c5e-4e41-a595-d61e87372db5 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:22.503132 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8d2344e4-3c5e-4e41-a595-d61e87372db5 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:22.503581 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8d2344e4-3c5e-4e41-a595-d61e87372db5 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:22.792640 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-8d2344e4-3c5e-4e41-a595-d61e87372db5 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b22f27c7144a3d96f41747473fe646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0a418ceb742fdb01c98c5d58424a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:22.801224 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-8d2344e4-3c5e-4e41-a595-d61e87372db5 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] 10.222.0.16 "GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39" status: 200 len: 1560 microversion: 2.1 time: 0.311209 Oct 17 03:59:22.801796 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 437/870] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:59:22 2022] GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39 => generated 1560 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:59:23.520079 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-98eea51f-92b4-450f-bdd4-2b12508e3a5b tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8a46e1d2-ac6f-4dd5-8060-6d132163c982"}} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:59:23.522517 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-98eea51f-92b4-450f-bdd4-2b12508e3a5b tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: 53df9edf-f0ce-44bd-82fb-378d51d91e67] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:23.528984 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-98eea51f-92b4-450f-bdd4-2b12508e3a5b tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:23.529503 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-98eea51f-92b4-450f-bdd4-2b12508e3a5b tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:23.529954 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-98eea51f-92b4-450f-bdd4-2b12508e3a5b tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:23.530639 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-98eea51f-92b4-450f-bdd4-2b12508e3a5b tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:23.531150 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-98eea51f-92b4-450f-bdd4-2b12508e3a5b tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:23.532664 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-98eea51f-92b4-450f-bdd4-2b12508e3a5b tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:24.227626 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-98eea51f-92b4-450f-bdd4-2b12508e3a5b tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "POST /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.711232 Oct 17 03:59:24.228224 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 434/871] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Oct 17 03:59:23 2022] POST /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67/os-volume_attachments => generated 194 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:59:26.479197 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-7f5f6b62-d637-4452-8d98-b087d2e9ac18 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:26.481311 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-7f5f6b62-d637-4452-8d98-b087d2e9ac18 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: 53df9edf-f0ce-44bd-82fb-378d51d91e67] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:26.488044 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7f5f6b62-d637-4452-8d98-b087d2e9ac18 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:26.488530 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7f5f6b62-d637-4452-8d98-b087d2e9ac18 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:26.488966 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7f5f6b62-d637-4452-8d98-b087d2e9ac18 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:26.489653 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7f5f6b62-d637-4452-8d98-b087d2e9ac18 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:26.490110 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7f5f6b62-d637-4452-8d98-b087d2e9ac18 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:26.490541 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7f5f6b62-d637-4452-8d98-b087d2e9ac18 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:26.521168 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-7f5f6b62-d637-4452-8d98-b087d2e9ac18 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046002 Oct 17 03:59:26.527658 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 438/872] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 17 03:59:26 2022] GET /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:59:26.533779 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-157a9de3-53ea-4ce1-b316-bb19152ddb00 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:26.534367 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-157a9de3-53ea-4ce1-b316-bb19152ddb00 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: 53df9edf-f0ce-44bd-82fb-378d51d91e67] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:26.540665 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-157a9de3-53ea-4ce1-b316-bb19152ddb00 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:26.541156 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-157a9de3-53ea-4ce1-b316-bb19152ddb00 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:26.541685 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-157a9de3-53ea-4ce1-b316-bb19152ddb00 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:26.542381 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-157a9de3-53ea-4ce1-b316-bb19152ddb00 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:26.542837 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-157a9de3-53ea-4ce1-b316-bb19152ddb00 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:26.543281 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-157a9de3-53ea-4ce1-b316-bb19152ddb00 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:26.573932 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-157a9de3-53ea-4ce1-b316-bb19152ddb00 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67/os-volume_attachments/8a46e1d2-ac6f-4dd5-8060-6d132163c982" status: 200 len: 194 microversion: 2.1 time: 0.044980 Oct 17 03:59:26.574520 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 435/873] 10.222.0.16 () {58 vars in 1413 bytes} [Mon Oct 17 03:59:26 2022] GET /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67/os-volume_attachments/8a46e1d2-ac6f-4dd5-8060-6d132163c982 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 03:59:28.133800 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-ef5784c7-4ede-4774-b508-30e221a2416e tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3a1f9714-0c09-450c-95a7-75e963288aba"}} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:59:28.136191 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-ef5784c7-4ede-4774-b508-30e221a2416e tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: 53df9edf-f0ce-44bd-82fb-378d51d91e67] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:28.142999 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ef5784c7-4ede-4774-b508-30e221a2416e tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:28.143519 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ef5784c7-4ede-4774-b508-30e221a2416e tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:28.143956 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ef5784c7-4ede-4774-b508-30e221a2416e tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:28.144656 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ef5784c7-4ede-4774-b508-30e221a2416e tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:28.145114 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ef5784c7-4ede-4774-b508-30e221a2416e tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:28.145539 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ef5784c7-4ede-4774-b508-30e221a2416e tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:28.162270 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:59:28.891270 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-ef5784c7-4ede-4774-b508-30e221a2416e tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "POST /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.761144 Oct 17 03:59:28.892559 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 439/874] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Oct 17 03:59:28 2022] POST /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67/os-volume_attachments => generated 194 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 03:59:31.133525 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-a93c46e0-b5ee-4a5e-85f2-fe5845029a46 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:31.135924 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-a93c46e0-b5ee-4a5e-85f2-fe5845029a46 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: 53df9edf-f0ce-44bd-82fb-378d51d91e67] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:31.143010 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a93c46e0-b5ee-4a5e-85f2-fe5845029a46 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:31.143534 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a93c46e0-b5ee-4a5e-85f2-fe5845029a46 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:31.143978 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a93c46e0-b5ee-4a5e-85f2-fe5845029a46 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:31.144674 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a93c46e0-b5ee-4a5e-85f2-fe5845029a46 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:31.145133 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a93c46e0-b5ee-4a5e-85f2-fe5845029a46 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:31.145567 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a93c46e0-b5ee-4a5e-85f2-fe5845029a46 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:31.175403 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-a93c46e0-b5ee-4a5e-85f2-fe5845029a46 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045832 Oct 17 03:59:31.175894 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 436/875] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 17 03:59:31 2022] GET /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:59:31.316900 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-ab02ff54-284e-4780-a653-8e96ee220ec1 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:31.317488 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-ab02ff54-284e-4780-a653-8e96ee220ec1 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: 53df9edf-f0ce-44bd-82fb-378d51d91e67] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:31.323715 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ab02ff54-284e-4780-a653-8e96ee220ec1 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:31.324209 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ab02ff54-284e-4780-a653-8e96ee220ec1 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:31.324657 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ab02ff54-284e-4780-a653-8e96ee220ec1 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:31.325359 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ab02ff54-284e-4780-a653-8e96ee220ec1 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:31.325818 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ab02ff54-284e-4780-a653-8e96ee220ec1 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:31.326243 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ab02ff54-284e-4780-a653-8e96ee220ec1 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:31.357492 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-ab02ff54-284e-4780-a653-8e96ee220ec1 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67/os-volume_attachments/8a46e1d2-ac6f-4dd5-8060-6d132163c982" status: 200 len: 194 microversion: 2.1 time: 0.045592 Oct 17 03:59:31.358074 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 440/876] 10.222.0.16 () {58 vars in 1413 bytes} [Mon Oct 17 03:59:31 2022] GET /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67/os-volume_attachments/8a46e1d2-ac6f-4dd5-8060-6d132163c982 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:59:31.368922 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-358fac0d-620b-4d54-a9f4-220392f501cf tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:31.369456 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-358fac0d-620b-4d54-a9f4-220392f501cf tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: 53df9edf-f0ce-44bd-82fb-378d51d91e67] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:31.375520 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-358fac0d-620b-4d54-a9f4-220392f501cf tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:31.376006 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-358fac0d-620b-4d54-a9f4-220392f501cf tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:31.376442 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-358fac0d-620b-4d54-a9f4-220392f501cf tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:31.377142 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-358fac0d-620b-4d54-a9f4-220392f501cf tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:31.377595 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-358fac0d-620b-4d54-a9f4-220392f501cf tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:31.378022 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-358fac0d-620b-4d54-a9f4-220392f501cf tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:31.461715 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.objects.instance [None req-358fac0d-620b-4d54-a9f4-220392f501cf tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lazy-loading 'services' on Instance uuid 53df9edf-f0ce-44bd-82fb-378d51d91e67 {{(pid=125872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:59:31.674742 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-358fac0d-620b-4d54-a9f4-220392f501cf tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "DELETE /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67/os-volume_attachments/8a46e1d2-ac6f-4dd5-8060-6d132163c982" status: 202 len: 0 microversion: 2.1 time: 0.309731 Oct 17 03:59:31.675388 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 437/877] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Oct 17 03:59:31 2022] DELETE /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67/os-volume_attachments/8a46e1d2-ac6f-4dd5-8060-6d132163c982 => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 03:59:32.819718 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-561171c0-db14-4a17-b80f-4b3ac36d999e tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:32.820284 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-561171c0-db14-4a17-b80f-4b3ac36d999e tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: 53df9edf-f0ce-44bd-82fb-378d51d91e67] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:32.826802 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-561171c0-db14-4a17-b80f-4b3ac36d999e tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:32.827336 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-561171c0-db14-4a17-b80f-4b3ac36d999e tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:32.828541 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-561171c0-db14-4a17-b80f-4b3ac36d999e tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:32.828968 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-561171c0-db14-4a17-b80f-4b3ac36d999e tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:32.829424 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-561171c0-db14-4a17-b80f-4b3ac36d999e tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:32.829853 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-561171c0-db14-4a17-b80f-4b3ac36d999e tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:32.863770 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-561171c0-db14-4a17-b80f-4b3ac36d999e tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67/os-volume_attachments/3a1f9714-0c09-450c-95a7-75e963288aba" status: 200 len: 194 microversion: 2.1 time: 0.048103 Oct 17 03:59:32.864472 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 441/878] 10.222.0.16 () {58 vars in 1413 bytes} [Mon Oct 17 03:59:32 2022] GET /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67/os-volume_attachments/3a1f9714-0c09-450c-95a7-75e963288aba => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:59:32.879253 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-810bb0f4-5dbf-48e9-a5f1-f30a091b7ece tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:32.880498 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-810bb0f4-5dbf-48e9-a5f1-f30a091b7ece tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: 53df9edf-f0ce-44bd-82fb-378d51d91e67] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:32.886990 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-810bb0f4-5dbf-48e9-a5f1-f30a091b7ece tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:32.887591 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-810bb0f4-5dbf-48e9-a5f1-f30a091b7ece tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:32.888119 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-810bb0f4-5dbf-48e9-a5f1-f30a091b7ece tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:32.888926 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-810bb0f4-5dbf-48e9-a5f1-f30a091b7ece tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:32.889649 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-810bb0f4-5dbf-48e9-a5f1-f30a091b7ece tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:32.890176 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-810bb0f4-5dbf-48e9-a5f1-f30a091b7ece tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:32.974247 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.objects.instance [None req-810bb0f4-5dbf-48e9-a5f1-f30a091b7ece tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lazy-loading 'services' on Instance uuid 53df9edf-f0ce-44bd-82fb-378d51d91e67 {{(pid=125872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:59:33.137188 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-810bb0f4-5dbf-48e9-a5f1-f30a091b7ece tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "DELETE /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67/os-volume_attachments/3a1f9714-0c09-450c-95a7-75e963288aba" status: 202 len: 0 microversion: 2.1 time: 0.262960 Oct 17 03:59:33.137764 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 438/879] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Oct 17 03:59:32 2022] DELETE /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67/os-volume_attachments/3a1f9714-0c09-450c-95a7-75e963288aba => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 03:59:34.321834 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-0e060dc3-3735-4b14-b7f8-d03e04f99956 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:34.324119 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-0e060dc3-3735-4b14-b7f8-d03e04f99956 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: 53df9edf-f0ce-44bd-82fb-378d51d91e67] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:34.331057 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0e060dc3-3735-4b14-b7f8-d03e04f99956 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:34.331574 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0e060dc3-3735-4b14-b7f8-d03e04f99956 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:34.332013 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0e060dc3-3735-4b14-b7f8-d03e04f99956 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:34.332709 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0e060dc3-3735-4b14-b7f8-d03e04f99956 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:34.333163 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0e060dc3-3735-4b14-b7f8-d03e04f99956 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:34.333707 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0e060dc3-3735-4b14-b7f8-d03e04f99956 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:34.364558 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-0e060dc3-3735-4b14-b7f8-d03e04f99956 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046826 Oct 17 03:59:34.365156 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 442/880] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 17 03:59:34 2022] GET /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 03:59:34.481385 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-cc3f1713-e681-405a-8de4-05a9d0112db3 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:34.483737 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-cc3f1713-e681-405a-8de4-05a9d0112db3 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: 53df9edf-f0ce-44bd-82fb-378d51d91e67] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:34.490069 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-cc3f1713-e681-405a-8de4-05a9d0112db3 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:34.490730 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-cc3f1713-e681-405a-8de4-05a9d0112db3 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:34.491203 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-cc3f1713-e681-405a-8de4-05a9d0112db3 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:34.491887 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-cc3f1713-e681-405a-8de4-05a9d0112db3 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:34.492340 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-cc3f1713-e681-405a-8de4-05a9d0112db3 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:34.492753 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-cc3f1713-e681-405a-8de4-05a9d0112db3 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:34.522593 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-cc3f1713-e681-405a-8de4-05a9d0112db3 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046386 Oct 17 03:59:34.523141 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 439/881] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 17 03:59:34 2022] GET /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 03:59:34.588745 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-7f397410-e949-4b19-b343-d5a1eba76d08 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:34.589238 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-7f397410-e949-4b19-b343-d5a1eba76d08 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: 53df9edf-f0ce-44bd-82fb-378d51d91e67] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:34.595336 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7f397410-e949-4b19-b343-d5a1eba76d08 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:34.595817 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7f397410-e949-4b19-b343-d5a1eba76d08 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:34.596249 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7f397410-e949-4b19-b343-d5a1eba76d08 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:34.597004 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7f397410-e949-4b19-b343-d5a1eba76d08 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:34.597453 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7f397410-e949-4b19-b343-d5a1eba76d08 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:34.597874 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7f397410-e949-4b19-b343-d5a1eba76d08 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:34.621960 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-7f397410-e949-4b19-b343-d5a1eba76d08 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: 53df9edf-f0ce-44bd-82fb-378d51d91e67] Going to try to terminate instance {{(pid=125871) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 03:59:34.885319 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-7f397410-e949-4b19-b343-d5a1eba76d08 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "DELETE /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67" status: 204 len: 0 microversion: 2.1 time: 0.300154 Oct 17 03:59:34.885907 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 443/882] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 17 03:59:34 2022] DELETE /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 03:59:34.894502 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-0e2591a8-be9e-4edd-9d94-b182d16b0fe5 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:34.895115 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-0e2591a8-be9e-4edd-9d94-b182d16b0fe5 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: 53df9edf-f0ce-44bd-82fb-378d51d91e67] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:34.900974 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0e2591a8-be9e-4edd-9d94-b182d16b0fe5 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:34.901455 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0e2591a8-be9e-4edd-9d94-b182d16b0fe5 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:34.901883 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0e2591a8-be9e-4edd-9d94-b182d16b0fe5 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:34.902566 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0e2591a8-be9e-4edd-9d94-b182d16b0fe5 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:34.903016 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0e2591a8-be9e-4edd-9d94-b182d16b0fe5 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:34.903461 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0e2591a8-be9e-4edd-9d94-b182d16b0fe5 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:35.274200 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-0e2591a8-be9e-4edd-9d94-b182d16b0fe5 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:35.282417 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-0e2591a8-be9e-4edd-9d94-b182d16b0fe5 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67" status: 200 len: 1673 microversion: 2.1 time: 0.391853 Oct 17 03:59:35.283014 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 440/883] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:59:34 2022] GET /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67 => generated 1673 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:59:36.305402 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-2b0896d2-c15e-4128-9fa1-b322007ce100 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:36.306185 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-2b0896d2-c15e-4128-9fa1-b322007ce100 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: 53df9edf-f0ce-44bd-82fb-378d51d91e67] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:36.308574 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=2 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:59:36.313148 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2b0896d2-c15e-4128-9fa1-b322007ce100 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:36.313678 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2b0896d2-c15e-4128-9fa1-b322007ce100 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:36.314109 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2b0896d2-c15e-4128-9fa1-b322007ce100 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:36.314800 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2b0896d2-c15e-4128-9fa1-b322007ce100 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:36.315272 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2b0896d2-c15e-4128-9fa1-b322007ce100 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:36.315695 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2b0896d2-c15e-4128-9fa1-b322007ce100 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:36.448546 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-2b0896d2-c15e-4128-9fa1-b322007ce100 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:36.456737 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-2b0896d2-c15e-4128-9fa1-b322007ce100 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67" status: 200 len: 1673 microversion: 2.1 time: 0.155489 Oct 17 03:59:36.457308 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 444/884] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:59:36 2022] GET /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67 => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:59:37.487275 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-45ca5c8f-6c26-4021-be7c-e1ee6d83e4a0 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:37.488079 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-45ca5c8f-6c26-4021-be7c-e1ee6d83e4a0 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: 53df9edf-f0ce-44bd-82fb-378d51d91e67] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:37.494477 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-45ca5c8f-6c26-4021-be7c-e1ee6d83e4a0 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:37.495248 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-45ca5c8f-6c26-4021-be7c-e1ee6d83e4a0 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:37.495937 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-45ca5c8f-6c26-4021-be7c-e1ee6d83e4a0 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:37.497341 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-45ca5c8f-6c26-4021-be7c-e1ee6d83e4a0 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:37.497970 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-45ca5c8f-6c26-4021-be7c-e1ee6d83e4a0 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:37.498404 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-45ca5c8f-6c26-4021-be7c-e1ee6d83e4a0 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:37.655126 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-45ca5c8f-6c26-4021-be7c-e1ee6d83e4a0 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:37.658309 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:59:37.664531 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-45ca5c8f-6c26-4021-be7c-e1ee6d83e4a0 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67" status: 200 len: 1673 microversion: 2.1 time: 0.182050 Oct 17 03:59:37.665174 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 441/885] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:59:37 2022] GET /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67 => generated 1673 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:59:37.998156 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [req-9dda7772-bf2c-4a0c-86dc-ab3bf9a835b2 req-30088dff-4c2b-4e24-afc3-8fa5d9d5229a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53df9edf-f0ce-44bd-82fb-378d51d91e67", "name": "network-vif-deleted", "tag": "434914fe-0f7a-41ed-883f-4183e0fdc295"}]} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:59:38.007943 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-9dda7772-bf2c-4a0c-86dc-ab3bf9a835b2 req-30088dff-4c2b-4e24-afc3-8fa5d9d5229a service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:38.008422 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-9dda7772-bf2c-4a0c-86dc-ab3bf9a835b2 req-30088dff-4c2b-4e24-afc3-8fa5d9d5229a service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:38.009043 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-9dda7772-bf2c-4a0c-86dc-ab3bf9a835b2 req-30088dff-4c2b-4e24-afc3-8fa5d9d5229a service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:38.020964 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.compute.server_external_events [req-9dda7772-bf2c-4a0c-86dc-ab3bf9a835b2 req-30088dff-4c2b-4e24-afc3-8fa5d9d5229a service nova] Creating event network-vif-deleted:434914fe-0f7a-41ed-883f-4183e0fdc295 for instance 53df9edf-f0ce-44bd-82fb-378d51d91e67 on hv-cinder-81558 Oct 17 03:59:38.025880 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [req-9dda7772-bf2c-4a0c-86dc-ab3bf9a835b2 req-30088dff-4c2b-4e24-afc3-8fa5d9d5229a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031672 Oct 17 03:59:38.026463 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 445/886] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 03:59:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:59:38.689909 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-3568301f-bb3c-4365-8bde-3b317a49aab3 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:38.690529 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-3568301f-bb3c-4365-8bde-3b317a49aab3 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: 53df9edf-f0ce-44bd-82fb-378d51d91e67] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:38.698296 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-3568301f-bb3c-4365-8bde-3b317a49aab3 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:38.698777 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-3568301f-bb3c-4365-8bde-3b317a49aab3 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:38.699227 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-3568301f-bb3c-4365-8bde-3b317a49aab3 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:38.699961 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-3568301f-bb3c-4365-8bde-3b317a49aab3 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:38.700410 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-3568301f-bb3c-4365-8bde-3b317a49aab3 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:38.701010 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-3568301f-bb3c-4365-8bde-3b317a49aab3 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:38.732539 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-3568301f-bb3c-4365-8bde-3b317a49aab3 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:38.733019 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-3568301f-bb3c-4365-8bde-3b317a49aab3 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:38.733451 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-3568301f-bb3c-4365-8bde-3b317a49aab3 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:38.733889 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.objects.instance [None req-3568301f-bb3c-4365-8bde-3b317a49aab3 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lazy-loading 'fault' on Instance uuid 53df9edf-f0ce-44bd-82fb-378d51d91e67 {{(pid=125872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:59:38.776258 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-3568301f-bb3c-4365-8bde-3b317a49aab3 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa4e226ad74685a5de6988b616b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dcae38b1a3c47f2a80ae967d9298356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:38.785291 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-3568301f-bb3c-4365-8bde-3b317a49aab3 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67" status: 200 len: 1328 microversion: 2.1 time: 0.100116 Oct 17 03:59:38.785895 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 442/887] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:59:38 2022] GET /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67 => generated 1328 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:59:39.809401 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-c8203dde-edfb-49e4-8aad-3172abbc2619 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:39.810453 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-c8203dde-edfb-49e4-8aad-3172abbc2619 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: 53df9edf-f0ce-44bd-82fb-378d51d91e67] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:39.817009 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c8203dde-edfb-49e4-8aad-3172abbc2619 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:39.817491 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c8203dde-edfb-49e4-8aad-3172abbc2619 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:39.817923 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c8203dde-edfb-49e4-8aad-3172abbc2619 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:39.818614 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c8203dde-edfb-49e4-8aad-3172abbc2619 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:39.819063 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c8203dde-edfb-49e4-8aad-3172abbc2619 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:39.819506 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c8203dde-edfb-49e4-8aad-3172abbc2619 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:39.833008 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.wsgi [None req-c8203dde-edfb-49e4-8aad-3172abbc2619 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] HTTP exception thrown: Instance 53df9edf-f0ce-44bd-82fb-378d51d91e67 could not be found. Oct 17 03:59:39.834609 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-c8203dde-edfb-49e4-8aad-3172abbc2619 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Request method failure captured: Oct 17 03:59:39.834609 dv-cinder-815582-16-smb devstack@n-api.service[125871]: request: GET /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67 HTTP/1.1 Oct 17 03:59:39.834609 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Accept: application/json Oct 17 03:59:39.834609 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Accept-Encoding: identity Oct 17 03:59:39.834609 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Connection: close Oct 17 03:59:39.834609 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Content-Length: 0 Oct 17 03:59:39.834609 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Content-Type: application/json Oct 17 03:59:39.834609 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Host: 10.222.0.16 Oct 17 03:59:39.834609 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Openstack-System-Scope: None Oct 17 03:59:39.834609 dv-cinder-815582-16-smb devstack@n-api.service[125871]: User-Agent: python-urllib3/1.26.12 Oct 17 03:59:39.834609 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Auth-Token: gAAAAABjTNHUiswWUhnjrR0hhoZeBffyByNZMrVmxd7bbTltcs3y2d4X7FFBbz_yIGdLFeb518UuzyqRupxLW69Zh6ny5zjddLi-PO8dd82WRy9WZpOqXU2BWS_D84rv_GQlxceW_SISy7XTfa1d-UELv8BREYBmaUTtIB8UTdn2Ve5EuQx5RCA Oct 17 03:59:39.834609 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Domain-Id: None Oct 17 03:59:39.834609 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Domain-Name: None Oct 17 03:59:39.834609 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Identity-Status: Confirmed Oct 17 03:59:39.834609 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Is-Admin-Project: True Oct 17 03:59:39.834609 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Domain-Id: default Oct 17 03:59:39.834609 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Domain-Name: Default Oct 17 03:59:39.834609 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Id: 4dcae38b1a3c47f2a80ae967d9298356 Oct 17 03:59:39.834609 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Name: tempest-AttachVolumeTestJSON-721155800 Oct 17 03:59:39.834609 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Role: reader,member Oct 17 03:59:39.834609 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Roles: reader,member Oct 17 03:59:39.836298 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4dcae38b1a3c47f2a80ae967d9298356"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4dcae38b1a3c47f2a80ae967d9298356"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4dcae38b1a3c47f2a80ae967d9298356"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4dcae38b1a3c47f2a80ae967d9298356", "adminURL": "http://10.222.0.16:8080"}]}] Oct 17 03:59:39.836298 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant: tempest-AttachVolumeTestJSON-721155800 Oct 17 03:59:39.836298 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant-Id: 4dcae38b1a3c47f2a80ae967d9298356 Oct 17 03:59:39.836298 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant-Name: tempest-AttachVolumeTestJSON-721155800 Oct 17 03:59:39.836298 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User: tempest-AttachVolumeTestJSON-721155800-project Oct 17 03:59:39.836298 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Domain-Id: default Oct 17 03:59:39.836298 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Domain-Name: Default Oct 17 03:59:39.836298 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Id: 6faa4e226ad74685a5de6988b616b070 Oct 17 03:59:39.836298 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Name: tempest-AttachVolumeTestJSON-721155800-project Oct 17 03:59:39.836298 dv-cinder-815582-16-smb devstack@n-api.service[125871]: method: > Oct 17 03:59:39.836298 dv-cinder-815582-16-smb devstack@n-api.service[125871]: exception: Instance 53df9edf-f0ce-44bd-82fb-378d51d91e67 could not be found. Oct 17 03:59:39.836298 dv-cinder-815582-16-smb devstack@n-api.service[125871]: action_args: {'id': '53df9edf-f0ce-44bd-82fb-378d51d91e67'} Oct 17 03:59:39.837408 dv-cinder-815582-16-smb devstack@n-api.service[125871]: {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:59:39.837408 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:59:39.837408 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 03:59:39.837408 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 03:59:39.837408 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 03:59:39.837408 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 03:59:39.837408 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 03:59:39.837408 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 03:59:39.837408 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 03:59:39.837408 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 03:59:39.837408 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53df9edf-f0ce-44bd-82fb-378d51d91e67 could not be found. Oct 17 03:59:39.837408 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:59:39.837408 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:59:39.837408 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:59:39.837408 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:59:39.837408 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:59:39.837408 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:59:39.837408 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:59:39.837408 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:59:39.837408 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:59:39.838974 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:59:39.838974 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 03:59:39.838974 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 03:59:39.838974 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 03:59:39.838974 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 03:59:39.838974 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 03:59:39.838974 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:59:39.838974 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53df9edf-f0ce-44bd-82fb-378d51d91e67 could not be found. Oct 17 03:59:39.838974 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:59:39.838974 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:59:39.838974 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:59:39.838974 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:59:39.838974 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:59:39.838974 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:59:39.838974 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:59:39.838974 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:59:39.838974 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53df9edf-f0ce-44bd-82fb-378d51d91e67 could not be found. Oct 17 03:59:39.838974 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:59:39.840390 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-c8203dde-edfb-49e4-8aad-3172abbc2619 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Returning 404 to user: Instance 53df9edf-f0ce-44bd-82fb-378d51d91e67 could not be found. {{(pid=125871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:59:39.840390 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-c8203dde-edfb-49e4-8aad-3172abbc2619 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67" status: 404 len: 111 microversion: 2.1 time: 0.031482 Oct 17 03:59:39.840390 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 446/888] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:59:39 2022] GET /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 03:59:39.849089 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-b718b91d-70e2-4a7a-9fd1-6672dd2d568c tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '.version_select at 0x7fd72a640dc0>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:39.918593 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-b718b91d-70e2-4a7a-9fd1-6672dd2d568c tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1909019679" status: 202 len: 0 microversion: 2.1 time: 0.070951 Oct 17 03:59:39.918593 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 443/889] 10.222.0.16 () {58 vars in 1221 bytes} [Mon Oct 17 03:59:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1909019679 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 03:59:43.365828 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-39875762-d55f-4ebc-b89b-7053988eafc3 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:43.366340 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-39875762-d55f-4ebc-b89b-7053988eafc3 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: 53df9edf-f0ce-44bd-82fb-378d51d91e67] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:43.372776 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-39875762-d55f-4ebc-b89b-7053988eafc3 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:43.373261 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-39875762-d55f-4ebc-b89b-7053988eafc3 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:43.373705 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-39875762-d55f-4ebc-b89b-7053988eafc3 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:43.374392 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-39875762-d55f-4ebc-b89b-7053988eafc3 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:43.374849 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-39875762-d55f-4ebc-b89b-7053988eafc3 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:43.375304 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-39875762-d55f-4ebc-b89b-7053988eafc3 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:43.388997 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.wsgi [None req-39875762-d55f-4ebc-b89b-7053988eafc3 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] HTTP exception thrown: Instance 53df9edf-f0ce-44bd-82fb-378d51d91e67 could not be found. Oct 17 03:59:43.390758 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-39875762-d55f-4ebc-b89b-7053988eafc3 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Request method failure captured: Oct 17 03:59:43.390758 dv-cinder-815582-16-smb devstack@n-api.service[125871]: request: DELETE /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67 HTTP/1.1 Oct 17 03:59:43.390758 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Accept: application/json Oct 17 03:59:43.390758 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Accept-Encoding: identity Oct 17 03:59:43.390758 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Connection: close Oct 17 03:59:43.390758 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Content-Length: 0 Oct 17 03:59:43.390758 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Content-Type: application/json Oct 17 03:59:43.390758 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Host: 10.222.0.16 Oct 17 03:59:43.390758 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Openstack-System-Scope: None Oct 17 03:59:43.390758 dv-cinder-815582-16-smb devstack@n-api.service[125871]: User-Agent: python-urllib3/1.26.12 Oct 17 03:59:43.390758 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Auth-Token: gAAAAABjTNHUiswWUhnjrR0hhoZeBffyByNZMrVmxd7bbTltcs3y2d4X7FFBbz_yIGdLFeb518UuzyqRupxLW69Zh6ny5zjddLi-PO8dd82WRy9WZpOqXU2BWS_D84rv_GQlxceW_SISy7XTfa1d-UELv8BREYBmaUTtIB8UTdn2Ve5EuQx5RCA Oct 17 03:59:43.390758 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Domain-Id: None Oct 17 03:59:43.390758 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Domain-Name: None Oct 17 03:59:43.390758 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Identity-Status: Confirmed Oct 17 03:59:43.390758 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Is-Admin-Project: True Oct 17 03:59:43.390758 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Domain-Id: default Oct 17 03:59:43.390758 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Domain-Name: Default Oct 17 03:59:43.390758 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Id: 4dcae38b1a3c47f2a80ae967d9298356 Oct 17 03:59:43.390758 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Name: tempest-AttachVolumeTestJSON-721155800 Oct 17 03:59:43.390758 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Role: reader,member Oct 17 03:59:43.390758 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Roles: reader,member Oct 17 03:59:43.392539 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4dcae38b1a3c47f2a80ae967d9298356"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4dcae38b1a3c47f2a80ae967d9298356"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4dcae38b1a3c47f2a80ae967d9298356"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4dcae38b1a3c47f2a80ae967d9298356", "adminURL": "http://10.222.0.16:8080"}]}] Oct 17 03:59:43.392539 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant: tempest-AttachVolumeTestJSON-721155800 Oct 17 03:59:43.392539 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant-Id: 4dcae38b1a3c47f2a80ae967d9298356 Oct 17 03:59:43.392539 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant-Name: tempest-AttachVolumeTestJSON-721155800 Oct 17 03:59:43.392539 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User: tempest-AttachVolumeTestJSON-721155800-project Oct 17 03:59:43.392539 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Domain-Id: default Oct 17 03:59:43.392539 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Domain-Name: Default Oct 17 03:59:43.392539 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Id: 6faa4e226ad74685a5de6988b616b070 Oct 17 03:59:43.392539 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Name: tempest-AttachVolumeTestJSON-721155800-project Oct 17 03:59:43.392539 dv-cinder-815582-16-smb devstack@n-api.service[125871]: method: > Oct 17 03:59:43.392539 dv-cinder-815582-16-smb devstack@n-api.service[125871]: exception: Instance 53df9edf-f0ce-44bd-82fb-378d51d91e67 could not be found. Oct 17 03:59:43.392539 dv-cinder-815582-16-smb devstack@n-api.service[125871]: action_args: {'id': '53df9edf-f0ce-44bd-82fb-378d51d91e67'} Oct 17 03:59:43.393465 dv-cinder-815582-16-smb devstack@n-api.service[125871]: {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:59:43.393465 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:59:43.393465 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 03:59:43.393465 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 03:59:43.393465 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 03:59:43.393465 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 03:59:43.393465 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 03:59:43.393465 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 03:59:43.393465 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 03:59:43.393465 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 03:59:43.393465 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53df9edf-f0ce-44bd-82fb-378d51d91e67 could not be found. Oct 17 03:59:43.393465 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:59:43.393465 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:59:43.393465 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:59:43.393465 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:59:43.393465 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:59:43.393465 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:59:43.393465 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:59:43.393465 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:59:43.393465 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:59:43.395012 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:59:43.395012 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 03:59:43.395012 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 03:59:43.395012 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 03:59:43.395012 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 03:59:43.395012 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 03:59:43.395012 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 03:59:43.395012 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 03:59:43.395012 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:59:43.395012 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53df9edf-f0ce-44bd-82fb-378d51d91e67 could not be found. Oct 17 03:59:43.395012 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:59:43.395012 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:59:43.395012 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:59:43.395012 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:59:43.395012 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:59:43.395012 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:59:43.395012 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:59:43.395012 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:59:43.395012 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53df9edf-f0ce-44bd-82fb-378d51d91e67 could not be found. Oct 17 03:59:43.395012 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:59:43.403197 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-39875762-d55f-4ebc-b89b-7053988eafc3 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Returning 404 to user: Instance 53df9edf-f0ce-44bd-82fb-378d51d91e67 could not be found. {{(pid=125871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:59:43.403197 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-39875762-d55f-4ebc-b89b-7053988eafc3 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "DELETE /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67" status: 404 len: 111 microversion: 2.1 time: 0.030194 Oct 17 03:59:43.403197 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 447/890] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 17 03:59:43 2022] DELETE /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 03:59:43.403467 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-f359d70a-a6cc-4fca-a117-f701aac8c9f8 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:43.403467 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-f359d70a-a6cc-4fca-a117-f701aac8c9f8 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: 53df9edf-f0ce-44bd-82fb-378d51d91e67] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:43.403998 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:59:43.408947 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f359d70a-a6cc-4fca-a117-f701aac8c9f8 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:43.409434 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f359d70a-a6cc-4fca-a117-f701aac8c9f8 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:43.409879 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f359d70a-a6cc-4fca-a117-f701aac8c9f8 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:43.410576 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f359d70a-a6cc-4fca-a117-f701aac8c9f8 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:43.411033 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f359d70a-a6cc-4fca-a117-f701aac8c9f8 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:43.411498 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f359d70a-a6cc-4fca-a117-f701aac8c9f8 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:43.425383 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.wsgi [None req-f359d70a-a6cc-4fca-a117-f701aac8c9f8 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] HTTP exception thrown: Instance 53df9edf-f0ce-44bd-82fb-378d51d91e67 could not be found. Oct 17 03:59:43.427021 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-f359d70a-a6cc-4fca-a117-f701aac8c9f8 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Request method failure captured: Oct 17 03:59:43.427021 dv-cinder-815582-16-smb devstack@n-api.service[125872]: request: GET /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67 HTTP/1.1 Oct 17 03:59:43.427021 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Accept: application/json Oct 17 03:59:43.427021 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Accept-Encoding: identity Oct 17 03:59:43.427021 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Connection: close Oct 17 03:59:43.427021 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Content-Length: 0 Oct 17 03:59:43.427021 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Content-Type: application/json Oct 17 03:59:43.427021 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Host: 10.222.0.16 Oct 17 03:59:43.427021 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Openstack-System-Scope: None Oct 17 03:59:43.427021 dv-cinder-815582-16-smb devstack@n-api.service[125872]: User-Agent: python-urllib3/1.26.12 Oct 17 03:59:43.427021 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Auth-Token: gAAAAABjTNHUiswWUhnjrR0hhoZeBffyByNZMrVmxd7bbTltcs3y2d4X7FFBbz_yIGdLFeb518UuzyqRupxLW69Zh6ny5zjddLi-PO8dd82WRy9WZpOqXU2BWS_D84rv_GQlxceW_SISy7XTfa1d-UELv8BREYBmaUTtIB8UTdn2Ve5EuQx5RCA Oct 17 03:59:43.427021 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Domain-Id: None Oct 17 03:59:43.427021 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Domain-Name: None Oct 17 03:59:43.427021 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Identity-Status: Confirmed Oct 17 03:59:43.427021 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Is-Admin-Project: True Oct 17 03:59:43.427021 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Domain-Id: default Oct 17 03:59:43.427021 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Domain-Name: Default Oct 17 03:59:43.427021 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Id: 4dcae38b1a3c47f2a80ae967d9298356 Oct 17 03:59:43.427021 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Name: tempest-AttachVolumeTestJSON-721155800 Oct 17 03:59:43.427021 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Role: reader,member Oct 17 03:59:43.427021 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Roles: reader,member Oct 17 03:59:43.428610 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4dcae38b1a3c47f2a80ae967d9298356"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4dcae38b1a3c47f2a80ae967d9298356"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4dcae38b1a3c47f2a80ae967d9298356"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4dcae38b1a3c47f2a80ae967d9298356", "adminURL": "http://10.222.0.16:8080"}]}] Oct 17 03:59:43.428610 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant: tempest-AttachVolumeTestJSON-721155800 Oct 17 03:59:43.428610 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant-Id: 4dcae38b1a3c47f2a80ae967d9298356 Oct 17 03:59:43.428610 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant-Name: tempest-AttachVolumeTestJSON-721155800 Oct 17 03:59:43.428610 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User: tempest-AttachVolumeTestJSON-721155800-project Oct 17 03:59:43.428610 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Domain-Id: default Oct 17 03:59:43.428610 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Domain-Name: Default Oct 17 03:59:43.428610 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Id: 6faa4e226ad74685a5de6988b616b070 Oct 17 03:59:43.428610 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Name: tempest-AttachVolumeTestJSON-721155800-project Oct 17 03:59:43.428610 dv-cinder-815582-16-smb devstack@n-api.service[125872]: method: > Oct 17 03:59:43.428610 dv-cinder-815582-16-smb devstack@n-api.service[125872]: exception: Instance 53df9edf-f0ce-44bd-82fb-378d51d91e67 could not be found. Oct 17 03:59:43.428610 dv-cinder-815582-16-smb devstack@n-api.service[125872]: action_args: {'id': '53df9edf-f0ce-44bd-82fb-378d51d91e67'} Oct 17 03:59:43.429534 dv-cinder-815582-16-smb devstack@n-api.service[125872]: {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:59:43.429534 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:59:43.429534 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 03:59:43.429534 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 03:59:43.429534 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 03:59:43.429534 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 03:59:43.429534 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 03:59:43.429534 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 03:59:43.429534 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 03:59:43.429534 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 03:59:43.429534 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53df9edf-f0ce-44bd-82fb-378d51d91e67 could not be found. Oct 17 03:59:43.429534 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:59:43.429534 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:59:43.429534 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:59:43.429534 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:59:43.429534 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:59:43.429534 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:59:43.429534 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:59:43.429534 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:59:43.429534 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:59:43.431026 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:59:43.431026 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 03:59:43.431026 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 03:59:43.431026 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 03:59:43.431026 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 03:59:43.431026 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 03:59:43.431026 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:59:43.431026 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53df9edf-f0ce-44bd-82fb-378d51d91e67 could not be found. Oct 17 03:59:43.431026 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:59:43.431026 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:59:43.431026 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:59:43.431026 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:59:43.431026 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:59:43.431026 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:59:43.431026 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:59:43.431026 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:59:43.431026 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53df9edf-f0ce-44bd-82fb-378d51d91e67 could not be found. Oct 17 03:59:43.431026 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:59:43.432903 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-f359d70a-a6cc-4fca-a117-f701aac8c9f8 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Returning 404 to user: Instance 53df9edf-f0ce-44bd-82fb-378d51d91e67 could not be found. {{(pid=125872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:59:43.432903 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-f359d70a-a6cc-4fca-a117-f701aac8c9f8 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67" status: 404 len: 111 microversion: 2.1 time: 0.031690 Oct 17 03:59:43.432903 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 444/891] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:59:43 2022] GET /compute/v2.1/servers/53df9edf-f0ce-44bd-82fb-378d51d91e67 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 03:59:44.685560 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-dd7cc1f3-235a-4fcf-9990-1669d1bc0b41 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:44.686065 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-dd7cc1f3-235a-4fcf-9990-1669d1bc0b41 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:44.693779 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-dd7cc1f3-235a-4fcf-9990-1669d1bc0b41 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:44.694277 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-dd7cc1f3-235a-4fcf-9990-1669d1bc0b41 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:44.694721 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-dd7cc1f3-235a-4fcf-9990-1669d1bc0b41 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:44.695505 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-dd7cc1f3-235a-4fcf-9990-1669d1bc0b41 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:44.695933 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-dd7cc1f3-235a-4fcf-9990-1669d1bc0b41 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:44.696443 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-dd7cc1f3-235a-4fcf-9990-1669d1bc0b41 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:44.716056 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.wsgi [None req-dd7cc1f3-235a-4fcf-9990-1669d1bc0b41 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] HTTP exception thrown: Instance bf50abcd-84fd-4541-b899-b6f5dad606fe could not be found. Oct 17 03:59:44.716056 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-dd7cc1f3-235a-4fcf-9990-1669d1bc0b41 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Request method failure captured: Oct 17 03:59:44.716056 dv-cinder-815582-16-smb devstack@n-api.service[125871]: request: DELETE /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe HTTP/1.1 Oct 17 03:59:44.716056 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Accept: application/json Oct 17 03:59:44.716056 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Accept-Encoding: identity Oct 17 03:59:44.716056 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Connection: close Oct 17 03:59:44.716056 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Content-Length: 0 Oct 17 03:59:44.716056 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Content-Type: application/json Oct 17 03:59:44.716056 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Host: 10.222.0.16 Oct 17 03:59:44.716056 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Openstack-System-Scope: None Oct 17 03:59:44.716056 dv-cinder-815582-16-smb devstack@n-api.service[125871]: User-Agent: python-urllib3/1.26.12 Oct 17 03:59:44.716056 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Auth-Token: gAAAAABjTNHUiswWUhnjrR0hhoZeBffyByNZMrVmxd7bbTltcs3y2d4X7FFBbz_yIGdLFeb518UuzyqRupxLW69Zh6ny5zjddLi-PO8dd82WRy9WZpOqXU2BWS_D84rv_GQlxceW_SISy7XTfa1d-UELv8BREYBmaUTtIB8UTdn2Ve5EuQx5RCA Oct 17 03:59:44.716056 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Domain-Id: None Oct 17 03:59:44.716056 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Domain-Name: None Oct 17 03:59:44.716056 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Identity-Status: Confirmed Oct 17 03:59:44.716056 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Is-Admin-Project: True Oct 17 03:59:44.716056 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Domain-Id: default Oct 17 03:59:44.716056 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Domain-Name: Default Oct 17 03:59:44.716056 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Id: 4dcae38b1a3c47f2a80ae967d9298356 Oct 17 03:59:44.716056 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Name: tempest-AttachVolumeTestJSON-721155800 Oct 17 03:59:44.716056 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Role: reader,member Oct 17 03:59:44.716056 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Roles: reader,member Oct 17 03:59:44.717983 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4dcae38b1a3c47f2a80ae967d9298356"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4dcae38b1a3c47f2a80ae967d9298356"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4dcae38b1a3c47f2a80ae967d9298356"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4dcae38b1a3c47f2a80ae967d9298356", "adminURL": "http://10.222.0.16:8080"}]}] Oct 17 03:59:44.717983 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant: tempest-AttachVolumeTestJSON-721155800 Oct 17 03:59:44.717983 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant-Id: 4dcae38b1a3c47f2a80ae967d9298356 Oct 17 03:59:44.717983 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant-Name: tempest-AttachVolumeTestJSON-721155800 Oct 17 03:59:44.717983 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User: tempest-AttachVolumeTestJSON-721155800-project Oct 17 03:59:44.717983 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Domain-Id: default Oct 17 03:59:44.717983 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Domain-Name: Default Oct 17 03:59:44.717983 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Id: 6faa4e226ad74685a5de6988b616b070 Oct 17 03:59:44.717983 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Name: tempest-AttachVolumeTestJSON-721155800-project Oct 17 03:59:44.717983 dv-cinder-815582-16-smb devstack@n-api.service[125871]: method: > Oct 17 03:59:44.717983 dv-cinder-815582-16-smb devstack@n-api.service[125871]: exception: Instance bf50abcd-84fd-4541-b899-b6f5dad606fe could not be found. Oct 17 03:59:44.717983 dv-cinder-815582-16-smb devstack@n-api.service[125871]: action_args: {'id': 'bf50abcd-84fd-4541-b899-b6f5dad606fe'} Oct 17 03:59:44.718884 dv-cinder-815582-16-smb devstack@n-api.service[125871]: {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:59:44.718884 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:59:44.718884 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 03:59:44.718884 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 03:59:44.718884 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 03:59:44.718884 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 03:59:44.718884 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 03:59:44.718884 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 03:59:44.718884 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 03:59:44.718884 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 03:59:44.718884 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf50abcd-84fd-4541-b899-b6f5dad606fe could not be found. Oct 17 03:59:44.718884 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:59:44.718884 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:59:44.718884 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:59:44.718884 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:59:44.718884 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:59:44.718884 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:59:44.718884 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:59:44.718884 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:59:44.718884 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:59:44.720427 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:59:44.720427 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 03:59:44.720427 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 03:59:44.720427 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 03:59:44.720427 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 03:59:44.720427 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 03:59:44.720427 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 03:59:44.720427 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 03:59:44.720427 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:59:44.720427 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf50abcd-84fd-4541-b899-b6f5dad606fe could not be found. Oct 17 03:59:44.720427 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:59:44.720427 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:59:44.720427 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:59:44.720427 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:59:44.720427 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:59:44.720427 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:59:44.720427 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:59:44.720427 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:59:44.720427 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf50abcd-84fd-4541-b899-b6f5dad606fe could not be found. Oct 17 03:59:44.720427 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 03:59:44.721901 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-dd7cc1f3-235a-4fcf-9990-1669d1bc0b41 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Returning 404 to user: Instance bf50abcd-84fd-4541-b899-b6f5dad606fe could not be found. {{(pid=125871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:59:44.721901 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-dd7cc1f3-235a-4fcf-9990-1669d1bc0b41 tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 404 len: 111 microversion: 2.1 time: 0.032729 Oct 17 03:59:44.721901 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 448/892] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 17 03:59:44 2022] DELETE /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 03:59:44.723691 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-b6853a4e-1e5d-465a-9856-3a9cdfbaa3db tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:44.724308 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-b6853a4e-1e5d-465a-9856-3a9cdfbaa3db tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] [instance: bf50abcd-84fd-4541-b899-b6f5dad606fe] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:44.731719 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b6853a4e-1e5d-465a-9856-3a9cdfbaa3db tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:44.732204 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b6853a4e-1e5d-465a-9856-3a9cdfbaa3db tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:44.732636 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b6853a4e-1e5d-465a-9856-3a9cdfbaa3db tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:44.733321 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b6853a4e-1e5d-465a-9856-3a9cdfbaa3db tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:44.733770 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b6853a4e-1e5d-465a-9856-3a9cdfbaa3db tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:44.734187 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b6853a4e-1e5d-465a-9856-3a9cdfbaa3db tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:44.758751 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.wsgi [None req-b6853a4e-1e5d-465a-9856-3a9cdfbaa3db tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] HTTP exception thrown: Instance bf50abcd-84fd-4541-b899-b6f5dad606fe could not be found. Oct 17 03:59:44.760321 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-b6853a4e-1e5d-465a-9856-3a9cdfbaa3db tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Request method failure captured: Oct 17 03:59:44.760321 dv-cinder-815582-16-smb devstack@n-api.service[125872]: request: GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe HTTP/1.1 Oct 17 03:59:44.760321 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Accept: application/json Oct 17 03:59:44.760321 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Accept-Encoding: identity Oct 17 03:59:44.760321 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Connection: close Oct 17 03:59:44.760321 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Content-Length: 0 Oct 17 03:59:44.760321 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Content-Type: application/json Oct 17 03:59:44.760321 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Host: 10.222.0.16 Oct 17 03:59:44.760321 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Openstack-System-Scope: None Oct 17 03:59:44.760321 dv-cinder-815582-16-smb devstack@n-api.service[125872]: User-Agent: python-urllib3/1.26.12 Oct 17 03:59:44.760321 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Auth-Token: gAAAAABjTNHUiswWUhnjrR0hhoZeBffyByNZMrVmxd7bbTltcs3y2d4X7FFBbz_yIGdLFeb518UuzyqRupxLW69Zh6ny5zjddLi-PO8dd82WRy9WZpOqXU2BWS_D84rv_GQlxceW_SISy7XTfa1d-UELv8BREYBmaUTtIB8UTdn2Ve5EuQx5RCA Oct 17 03:59:44.760321 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Domain-Id: None Oct 17 03:59:44.760321 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Domain-Name: None Oct 17 03:59:44.760321 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Identity-Status: Confirmed Oct 17 03:59:44.760321 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Is-Admin-Project: True Oct 17 03:59:44.760321 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Domain-Id: default Oct 17 03:59:44.760321 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Domain-Name: Default Oct 17 03:59:44.760321 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Id: 4dcae38b1a3c47f2a80ae967d9298356 Oct 17 03:59:44.760321 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Name: tempest-AttachVolumeTestJSON-721155800 Oct 17 03:59:44.760321 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Role: reader,member Oct 17 03:59:44.760321 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Roles: reader,member Oct 17 03:59:44.761721 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4dcae38b1a3c47f2a80ae967d9298356"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4dcae38b1a3c47f2a80ae967d9298356"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4dcae38b1a3c47f2a80ae967d9298356"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4dcae38b1a3c47f2a80ae967d9298356", "adminURL": "http://10.222.0.16:8080"}]}] Oct 17 03:59:44.761721 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant: tempest-AttachVolumeTestJSON-721155800 Oct 17 03:59:44.761721 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant-Id: 4dcae38b1a3c47f2a80ae967d9298356 Oct 17 03:59:44.761721 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant-Name: tempest-AttachVolumeTestJSON-721155800 Oct 17 03:59:44.761721 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User: tempest-AttachVolumeTestJSON-721155800-project Oct 17 03:59:44.761721 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Domain-Id: default Oct 17 03:59:44.761721 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Domain-Name: Default Oct 17 03:59:44.761721 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Id: 6faa4e226ad74685a5de6988b616b070 Oct 17 03:59:44.761721 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Name: tempest-AttachVolumeTestJSON-721155800-project Oct 17 03:59:44.761721 dv-cinder-815582-16-smb devstack@n-api.service[125872]: method: > Oct 17 03:59:44.761721 dv-cinder-815582-16-smb devstack@n-api.service[125872]: exception: Instance bf50abcd-84fd-4541-b899-b6f5dad606fe could not be found. Oct 17 03:59:44.761721 dv-cinder-815582-16-smb devstack@n-api.service[125872]: action_args: {'id': 'bf50abcd-84fd-4541-b899-b6f5dad606fe'} Oct 17 03:59:44.762969 dv-cinder-815582-16-smb devstack@n-api.service[125872]: {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:59:44.762969 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:59:44.762969 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 03:59:44.762969 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 03:59:44.762969 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 03:59:44.762969 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 03:59:44.762969 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 03:59:44.762969 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 03:59:44.762969 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 03:59:44.762969 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 03:59:44.762969 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf50abcd-84fd-4541-b899-b6f5dad606fe could not be found. Oct 17 03:59:44.762969 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:59:44.762969 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:59:44.762969 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:59:44.762969 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:59:44.762969 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:59:44.762969 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:59:44.762969 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:59:44.762969 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:59:44.762969 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:59:44.764217 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:59:44.764217 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 03:59:44.764217 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 03:59:44.764217 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 03:59:44.764217 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 03:59:44.764217 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 03:59:44.764217 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:59:44.764217 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf50abcd-84fd-4541-b899-b6f5dad606fe could not be found. Oct 17 03:59:44.764217 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:59:44.764217 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:59:44.764217 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:59:44.764217 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:59:44.764217 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:59:44.764217 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:59:44.764217 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:59:44.764217 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:59:44.764217 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf50abcd-84fd-4541-b899-b6f5dad606fe could not be found. Oct 17 03:59:44.764217 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 03:59:44.765584 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-b6853a4e-1e5d-465a-9856-3a9cdfbaa3db tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] Returning 404 to user: Instance bf50abcd-84fd-4541-b899-b6f5dad606fe could not be found. {{(pid=125872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:59:44.765584 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-b6853a4e-1e5d-465a-9856-3a9cdfbaa3db tempest-AttachVolumeTestJSON-721155800 tempest-AttachVolumeTestJSON-721155800-project] 10.222.0.16 "GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe" status: 404 len: 111 microversion: 2.1 time: 0.042301 Oct 17 03:59:44.765584 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 445/893] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 03:59:44 2022] GET /compute/v2.1/servers/bf50abcd-84fd-4541-b899-b6f5dad606fe => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 03:59:46.241457 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-9e3d83a1-c2c0-4cf4-8d6c-68869d9bff39 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:46.242007 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-9e3d83a1-c2c0-4cf4-8d6c-68869d9bff39 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:46.248765 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-9e3d83a1-c2c0-4cf4-8d6c-68869d9bff39 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:46.249257 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-9e3d83a1-c2c0-4cf4-8d6c-68869d9bff39 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:46.249692 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-9e3d83a1-c2c0-4cf4-8d6c-68869d9bff39 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:46.250461 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-9e3d83a1-c2c0-4cf4-8d6c-68869d9bff39 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:46.250916 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-9e3d83a1-c2c0-4cf4-8d6c-68869d9bff39 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:46.252159 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-9e3d83a1-c2c0-4cf4-8d6c-68869d9bff39 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:46.277118 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-9e3d83a1-c2c0-4cf4-8d6c-68869d9bff39 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6/ips" status: 200 len: 152 microversion: 2.20 time: 0.039487 Oct 17 03:59:46.291476 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 449/894] 10.222.0.16 () {60 vars in 1289 bytes} [Mon Oct 17 03:59:46 2022] GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6/ips => generated 152 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 03:59:49.119119 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-7e4d5f42-7af9-4010-b2e3-8d42bf14dee3 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:59:49.119119 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-7e4d5f42-7af9-4010-b2e3-8d42bf14dee3 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:49.123839 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-7e4d5f42-7af9-4010-b2e3-8d42bf14dee3 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:49.124333 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-7e4d5f42-7af9-4010-b2e3-8d42bf14dee3 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:49.124789 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-7e4d5f42-7af9-4010-b2e3-8d42bf14dee3 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:49.125493 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-7e4d5f42-7af9-4010-b2e3-8d42bf14dee3 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:49.125951 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-7e4d5f42-7af9-4010-b2e3-8d42bf14dee3 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:49.126374 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-7e4d5f42-7af9-4010-b2e3-8d42bf14dee3 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:49.150253 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.objects.instance [None req-7e4d5f42-7af9-4010-b2e3-8d42bf14dee3 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lazy-loading 'flavor' on Instance uuid e5d69048-2557-4e13-92de-3381030814e6 {{(pid=125872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:59:49.770999 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-7e4d5f42-7af9-4010-b2e3-8d42bf14dee3 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "POST /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6/action" status: 202 len: 0 microversion: 2.20 time: 0.658288 Oct 17 03:59:49.771691 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 446/895] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Oct 17 03:59:49 2022] POST /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6/action => generated 0 bytes in 660 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 03:59:49.780066 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-27241f80-29e0-440a-aed2-f472e97f9548 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:49.780857 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-27241f80-29e0-440a-aed2-f472e97f9548 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:49.788251 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-27241f80-29e0-440a-aed2-f472e97f9548 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:49.788748 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-27241f80-29e0-440a-aed2-f472e97f9548 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:49.789184 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-27241f80-29e0-440a-aed2-f472e97f9548 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:49.789887 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-27241f80-29e0-440a-aed2-f472e97f9548 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:49.790341 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-27241f80-29e0-440a-aed2-f472e97f9548 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:49.790792 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-27241f80-29e0-440a-aed2-f472e97f9548 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:49.924089 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-27241f80-29e0-440a-aed2-f472e97f9548 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:49.932656 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-27241f80-29e0-440a-aed2-f472e97f9548 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:49.934181 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-27241f80-29e0-440a-aed2-f472e97f9548 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:49.935473 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-27241f80-29e0-440a-aed2-f472e97f9548 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6" status: 200 len: 1722 microversion: 2.20 time: 0.159286 Oct 17 03:59:49.936209 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 450/896] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:59:49 2022] GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:59:50.967199 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-26cd13ad-444a-4de6-9017-0e13a4010b9b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:50.971618 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-26cd13ad-444a-4de6-9017-0e13a4010b9b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:50.976029 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-26cd13ad-444a-4de6-9017-0e13a4010b9b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:50.976431 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-26cd13ad-444a-4de6-9017-0e13a4010b9b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:50.976864 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-26cd13ad-444a-4de6-9017-0e13a4010b9b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:50.977556 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-26cd13ad-444a-4de6-9017-0e13a4010b9b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:50.978000 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-26cd13ad-444a-4de6-9017-0e13a4010b9b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:50.978425 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-26cd13ad-444a-4de6-9017-0e13a4010b9b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:51.120325 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-26cd13ad-444a-4de6-9017-0e13a4010b9b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:51.128856 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-26cd13ad-444a-4de6-9017-0e13a4010b9b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:51.130321 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-26cd13ad-444a-4de6-9017-0e13a4010b9b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:51.131534 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-26cd13ad-444a-4de6-9017-0e13a4010b9b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6" status: 200 len: 1722 microversion: 2.20 time: 0.169309 Oct 17 03:59:51.133692 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 447/897] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:59:50 2022] GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:59:52.156879 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-7f35f430-a287-4240-83f3-28a42df49b45 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:52.157555 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-7f35f430-a287-4240-83f3-28a42df49b45 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:52.164001 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7f35f430-a287-4240-83f3-28a42df49b45 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:52.164473 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7f35f430-a287-4240-83f3-28a42df49b45 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:52.164906 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7f35f430-a287-4240-83f3-28a42df49b45 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:52.165591 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7f35f430-a287-4240-83f3-28a42df49b45 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:52.166041 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7f35f430-a287-4240-83f3-28a42df49b45 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:52.166463 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7f35f430-a287-4240-83f3-28a42df49b45 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:52.295509 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-7f35f430-a287-4240-83f3-28a42df49b45 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:52.304970 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-7f35f430-a287-4240-83f3-28a42df49b45 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:52.306418 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-7f35f430-a287-4240-83f3-28a42df49b45 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:52.307613 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-7f35f430-a287-4240-83f3-28a42df49b45 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6" status: 200 len: 1722 microversion: 2.20 time: 0.154587 Oct 17 03:59:52.308158 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 451/898] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:59:52 2022] GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:59:53.333697 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-9f90f44b-43e1-42d9-8372-179922dad568 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:53.334319 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-9f90f44b-43e1-42d9-8372-179922dad568 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:53.341168 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-9f90f44b-43e1-42d9-8372-179922dad568 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:53.341665 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-9f90f44b-43e1-42d9-8372-179922dad568 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:53.342102 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-9f90f44b-43e1-42d9-8372-179922dad568 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:53.342914 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-9f90f44b-43e1-42d9-8372-179922dad568 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:53.343799 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-9f90f44b-43e1-42d9-8372-179922dad568 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:53.344848 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-9f90f44b-43e1-42d9-8372-179922dad568 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:53.874703 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-9f90f44b-43e1-42d9-8372-179922dad568 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:53.883424 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-9f90f44b-43e1-42d9-8372-179922dad568 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:53.884911 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-9f90f44b-43e1-42d9-8372-179922dad568 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:53.886066 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-9f90f44b-43e1-42d9-8372-179922dad568 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6" status: 200 len: 1722 microversion: 2.20 time: 0.557232 Oct 17 03:59:53.886615 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 448/899] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:59:53 2022] GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6 => generated 1722 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:59:54.912246 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-c9691f91-9f3d-4c42-b80a-631ee5f43fe2 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:54.913070 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-c9691f91-9f3d-4c42-b80a-631ee5f43fe2 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:54.919766 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c9691f91-9f3d-4c42-b80a-631ee5f43fe2 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:54.920248 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c9691f91-9f3d-4c42-b80a-631ee5f43fe2 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:54.920688 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c9691f91-9f3d-4c42-b80a-631ee5f43fe2 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:54.921383 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c9691f91-9f3d-4c42-b80a-631ee5f43fe2 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:54.921931 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c9691f91-9f3d-4c42-b80a-631ee5f43fe2 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:54.922356 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c9691f91-9f3d-4c42-b80a-631ee5f43fe2 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:55.060613 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-c9691f91-9f3d-4c42-b80a-631ee5f43fe2 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:55.073195 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-c9691f91-9f3d-4c42-b80a-631ee5f43fe2 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:55.075064 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-c9691f91-9f3d-4c42-b80a-631ee5f43fe2 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:55.076289 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-c9691f91-9f3d-4c42-b80a-631ee5f43fe2 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6" status: 200 len: 1722 microversion: 2.20 time: 0.168049 Oct 17 03:59:55.076995 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 452/900] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:59:54 2022] GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:59:56.101951 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-55c5023c-8fd8-4b6b-8df8-35dbad837d5c tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:56.102512 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-55c5023c-8fd8-4b6b-8df8-35dbad837d5c tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:56.109570 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-55c5023c-8fd8-4b6b-8df8-35dbad837d5c tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:56.110056 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-55c5023c-8fd8-4b6b-8df8-35dbad837d5c tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:56.110490 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-55c5023c-8fd8-4b6b-8df8-35dbad837d5c tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:56.111752 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-55c5023c-8fd8-4b6b-8df8-35dbad837d5c tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:56.112211 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-55c5023c-8fd8-4b6b-8df8-35dbad837d5c tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:56.112636 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-55c5023c-8fd8-4b6b-8df8-35dbad837d5c tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:56.243509 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-55c5023c-8fd8-4b6b-8df8-35dbad837d5c tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:56.251873 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-55c5023c-8fd8-4b6b-8df8-35dbad837d5c tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:56.253321 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-55c5023c-8fd8-4b6b-8df8-35dbad837d5c tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:56.254500 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-55c5023c-8fd8-4b6b-8df8-35dbad837d5c tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6" status: 200 len: 1722 microversion: 2.20 time: 0.156492 Oct 17 03:59:56.255058 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 449/901] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:59:56 2022] GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:59:57.279355 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-128259b8-78c5-4304-83fd-ea4d11b65a6c tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:57.279896 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-128259b8-78c5-4304-83fd-ea4d11b65a6c tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:57.286251 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-128259b8-78c5-4304-83fd-ea4d11b65a6c tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:57.291099 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-128259b8-78c5-4304-83fd-ea4d11b65a6c tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:57.291099 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-128259b8-78c5-4304-83fd-ea4d11b65a6c tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:57.291099 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-128259b8-78c5-4304-83fd-ea4d11b65a6c tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:57.291099 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-128259b8-78c5-4304-83fd-ea4d11b65a6c tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:57.291509 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-128259b8-78c5-4304-83fd-ea4d11b65a6c tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:57.420161 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-128259b8-78c5-4304-83fd-ea4d11b65a6c tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:57.429542 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-128259b8-78c5-4304-83fd-ea4d11b65a6c tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:57.430438 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-128259b8-78c5-4304-83fd-ea4d11b65a6c tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:57.431531 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-128259b8-78c5-4304-83fd-ea4d11b65a6c tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6" status: 200 len: 1722 microversion: 2.20 time: 0.156185 Oct 17 03:59:57.432174 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 453/902] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:59:57 2022] GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:59:58.462656 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-8b1c9932-a1bb-45e4-acc2-5b6b1b00798d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:58.463297 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-8b1c9932-a1bb-45e4-acc2-5b6b1b00798d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:58.469774 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8b1c9932-a1bb-45e4-acc2-5b6b1b00798d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:58.470259 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8b1c9932-a1bb-45e4-acc2-5b6b1b00798d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:58.470693 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8b1c9932-a1bb-45e4-acc2-5b6b1b00798d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:58.471414 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8b1c9932-a1bb-45e4-acc2-5b6b1b00798d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:58.471872 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8b1c9932-a1bb-45e4-acc2-5b6b1b00798d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:58.472326 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8b1c9932-a1bb-45e4-acc2-5b6b1b00798d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:58.601265 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-8b1c9932-a1bb-45e4-acc2-5b6b1b00798d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:58.609375 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-8b1c9932-a1bb-45e4-acc2-5b6b1b00798d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:58.610798 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-8b1c9932-a1bb-45e4-acc2-5b6b1b00798d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:58.612048 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-8b1c9932-a1bb-45e4-acc2-5b6b1b00798d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6" status: 200 len: 1722 microversion: 2.20 time: 0.153362 Oct 17 03:59:58.612613 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 450/903] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:59:58 2022] GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:59:59.637678 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-54cc3311-c01e-4358-aa15-bd3dc33fe5aa tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:59:59.638223 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-54cc3311-c01e-4358-aa15-bd3dc33fe5aa tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:59:59.644686 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-54cc3311-c01e-4358-aa15-bd3dc33fe5aa tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:59.645161 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-54cc3311-c01e-4358-aa15-bd3dc33fe5aa tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:59.645591 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-54cc3311-c01e-4358-aa15-bd3dc33fe5aa tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:59.646278 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-54cc3311-c01e-4358-aa15-bd3dc33fe5aa tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:59:59.646716 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-54cc3311-c01e-4358-aa15-bd3dc33fe5aa tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:59:59.647139 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-54cc3311-c01e-4358-aa15-bd3dc33fe5aa tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:59:59.649772 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:59:59.779669 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-54cc3311-c01e-4358-aa15-bd3dc33fe5aa tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:59.787916 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-54cc3311-c01e-4358-aa15-bd3dc33fe5aa tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:59.789411 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-54cc3311-c01e-4358-aa15-bd3dc33fe5aa tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:59:59.790627 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-54cc3311-c01e-4358-aa15-bd3dc33fe5aa tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6" status: 200 len: 1722 microversion: 2.20 time: 0.157178 Oct 17 03:59:59.791198 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 454/904] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 03:59:59 2022] GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:00:00.817955 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-2dcf6495-8f4f-474e-8450-7828efb75f5d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:00.818565 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-2dcf6495-8f4f-474e-8450-7828efb75f5d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:00:00.824982 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2dcf6495-8f4f-474e-8450-7828efb75f5d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:00.825457 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2dcf6495-8f4f-474e-8450-7828efb75f5d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:00.825888 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2dcf6495-8f4f-474e-8450-7828efb75f5d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:00.826576 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2dcf6495-8f4f-474e-8450-7828efb75f5d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:00.827025 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2dcf6495-8f4f-474e-8450-7828efb75f5d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:00.827470 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2dcf6495-8f4f-474e-8450-7828efb75f5d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:00.959768 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-2dcf6495-8f4f-474e-8450-7828efb75f5d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:00.967599 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-2dcf6495-8f4f-474e-8450-7828efb75f5d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:00.969005 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-2dcf6495-8f4f-474e-8450-7828efb75f5d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:00.970152 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-2dcf6495-8f4f-474e-8450-7828efb75f5d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6" status: 200 len: 1743 microversion: 2.20 time: 0.156341 Oct 17 04:00:00.970702 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 451/905] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 04:00:00 2022] GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6 => generated 1743 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:00:01.996704 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-b3a33c19-4dc2-49df-8d8c-10d6383573e9 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:01.997252 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-b3a33c19-4dc2-49df-8d8c-10d6383573e9 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:00:02.005768 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b3a33c19-4dc2-49df-8d8c-10d6383573e9 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:02.006273 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b3a33c19-4dc2-49df-8d8c-10d6383573e9 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:02.006716 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b3a33c19-4dc2-49df-8d8c-10d6383573e9 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:02.007456 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b3a33c19-4dc2-49df-8d8c-10d6383573e9 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:02.007916 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b3a33c19-4dc2-49df-8d8c-10d6383573e9 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:02.008342 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b3a33c19-4dc2-49df-8d8c-10d6383573e9 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:02.150718 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-b3a33c19-4dc2-49df-8d8c-10d6383573e9 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:02.159134 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-b3a33c19-4dc2-49df-8d8c-10d6383573e9 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:02.160846 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-b3a33c19-4dc2-49df-8d8c-10d6383573e9 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:02.161998 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-b3a33c19-4dc2-49df-8d8c-10d6383573e9 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6" status: 200 len: 1743 microversion: 2.20 time: 0.169357 Oct 17 04:00:02.162551 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 455/906] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 04:00:01 2022] GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6 => generated 1743 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:00:03.188385 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-fbdcd7b6-104c-4834-a945-97d087c31f1f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:03.189038 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-fbdcd7b6-104c-4834-a945-97d087c31f1f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:00:03.196219 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-fbdcd7b6-104c-4834-a945-97d087c31f1f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:03.196709 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-fbdcd7b6-104c-4834-a945-97d087c31f1f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:03.197149 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-fbdcd7b6-104c-4834-a945-97d087c31f1f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:03.197852 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-fbdcd7b6-104c-4834-a945-97d087c31f1f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:03.198314 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-fbdcd7b6-104c-4834-a945-97d087c31f1f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:03.198747 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-fbdcd7b6-104c-4834-a945-97d087c31f1f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:03.354586 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-fbdcd7b6-104c-4834-a945-97d087c31f1f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:03.363711 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-fbdcd7b6-104c-4834-a945-97d087c31f1f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:03.365263 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-fbdcd7b6-104c-4834-a945-97d087c31f1f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:03.366415 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-fbdcd7b6-104c-4834-a945-97d087c31f1f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6" status: 200 len: 1738 microversion: 2.20 time: 0.181999 Oct 17 04:00:03.366968 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 452/907] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 04:00:03 2022] GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6 => generated 1738 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:00:03.637969 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-2acbdf90-139f-4b22-8fee-94282e76929b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:03.638737 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-2acbdf90-139f-4b22-8fee-94282e76929b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 9777f592-2e10-475d-b716-a98d5f1c3c4d] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:00:03.645291 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2acbdf90-139f-4b22-8fee-94282e76929b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:03.645965 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2acbdf90-139f-4b22-8fee-94282e76929b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:03.646399 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2acbdf90-139f-4b22-8fee-94282e76929b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:03.647274 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2acbdf90-139f-4b22-8fee-94282e76929b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:03.647727 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2acbdf90-139f-4b22-8fee-94282e76929b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:03.648264 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2acbdf90-139f-4b22-8fee-94282e76929b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:03.672579 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-2acbdf90-139f-4b22-8fee-94282e76929b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/9777f592-2e10-475d-b716-a98d5f1c3c4d/ips" status: 200 len: 151 microversion: 2.1 time: 0.038671 Oct 17 04:00:03.673143 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 456/908] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Oct 17 04:00:03 2022] GET /compute/v2.1/servers/9777f592-2e10-475d-b716-a98d5f1c3c4d/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 04:00:04.299211 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [req-132550c4-95fd-424a-960c-de9eb7255da4 req-89e29bd0-f7d4-4f8b-af76-2b4f566396bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5d69048-2557-4e13-92de-3381030814e6", "name": "network-vif-plugged", "status": "completed", "tag": "4983815b-2774-4cc1-a815-084c70865641"}]} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:00:04.339634 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-132550c4-95fd-424a-960c-de9eb7255da4 req-89e29bd0-f7d4-4f8b-af76-2b4f566396bb service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:04.342441 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-132550c4-95fd-424a-960c-de9eb7255da4 req-89e29bd0-f7d4-4f8b-af76-2b4f566396bb service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:04.342977 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-132550c4-95fd-424a-960c-de9eb7255da4 req-89e29bd0-f7d4-4f8b-af76-2b4f566396bb service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:04.366925 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.compute.server_external_events [req-132550c4-95fd-424a-960c-de9eb7255da4 req-89e29bd0-f7d4-4f8b-af76-2b4f566396bb service nova] Creating event network-vif-plugged:4983815b-2774-4cc1-a815-084c70865641 for instance e5d69048-2557-4e13-92de-3381030814e6 on hv-cinder-81558 Oct 17 04:00:04.374035 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [req-132550c4-95fd-424a-960c-de9eb7255da4 req-89e29bd0-f7d4-4f8b-af76-2b4f566396bb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.288749 Oct 17 04:00:04.376080 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 453/909] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 04:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:00:04.399961 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-cac40f58-2f55-482b-8e39-11527e86f04c tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:04.400865 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-cac40f58-2f55-482b-8e39-11527e86f04c tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:00:04.419340 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-cac40f58-2f55-482b-8e39-11527e86f04c tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:04.421330 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-cac40f58-2f55-482b-8e39-11527e86f04c tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:04.421805 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-cac40f58-2f55-482b-8e39-11527e86f04c tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:04.422558 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-cac40f58-2f55-482b-8e39-11527e86f04c tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:04.424926 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-cac40f58-2f55-482b-8e39-11527e86f04c tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:04.426953 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-cac40f58-2f55-482b-8e39-11527e86f04c tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:04.596088 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-cac40f58-2f55-482b-8e39-11527e86f04c tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:04.606975 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-cac40f58-2f55-482b-8e39-11527e86f04c tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:04.610486 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-cac40f58-2f55-482b-8e39-11527e86f04c tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:04.610486 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-cac40f58-2f55-482b-8e39-11527e86f04c tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6" status: 200 len: 1738 microversion: 2.20 time: 0.221629 Oct 17 04:00:04.633836 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 457/910] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 04:00:04 2022] GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6 => generated 1738 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:00:05.416678 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-fdb9c70b-4d80-473c-989b-491d7ba3d7cd tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "301dfb9f-ade8-4729-b8ba-c4ad8f49ab86"}} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:00:05.419385 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-fdb9c70b-4d80-473c-989b-491d7ba3d7cd tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 9777f592-2e10-475d-b716-a98d5f1c3c4d] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:00:05.426863 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-fdb9c70b-4d80-473c-989b-491d7ba3d7cd tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:05.427784 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-fdb9c70b-4d80-473c-989b-491d7ba3d7cd tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:05.428421 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-fdb9c70b-4d80-473c-989b-491d7ba3d7cd tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:05.429337 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-fdb9c70b-4d80-473c-989b-491d7ba3d7cd tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:05.429795 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-fdb9c70b-4d80-473c-989b-491d7ba3d7cd tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:05.430221 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-fdb9c70b-4d80-473c-989b-491d7ba3d7cd tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:05.641135 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-d568d7d0-fc69-47e5-86c8-9ac40ff7e991 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:05.641855 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-d568d7d0-fc69-47e5-86c8-9ac40ff7e991 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:00:05.649159 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d568d7d0-fc69-47e5-86c8-9ac40ff7e991 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:05.649710 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d568d7d0-fc69-47e5-86c8-9ac40ff7e991 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:05.650328 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d568d7d0-fc69-47e5-86c8-9ac40ff7e991 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:05.651561 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d568d7d0-fc69-47e5-86c8-9ac40ff7e991 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:05.652218 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d568d7d0-fc69-47e5-86c8-9ac40ff7e991 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:05.652858 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d568d7d0-fc69-47e5-86c8-9ac40ff7e991 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:05.815033 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-d568d7d0-fc69-47e5-86c8-9ac40ff7e991 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:05.826395 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-d568d7d0-fc69-47e5-86c8-9ac40ff7e991 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:05.828021 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-d568d7d0-fc69-47e5-86c8-9ac40ff7e991 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:05.829197 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-d568d7d0-fc69-47e5-86c8-9ac40ff7e991 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6" status: 200 len: 1738 microversion: 2.20 time: 0.192424 Oct 17 04:00:05.843848 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 458/911] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 04:00:05 2022] GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6 => generated 1738 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:00:06.231728 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-fdb9c70b-4d80-473c-989b-491d7ba3d7cd tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "POST /compute/v2.1/servers/9777f592-2e10-475d-b716-a98d5f1c3c4d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.816145 Oct 17 04:00:06.236256 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 454/912] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Oct 17 04:00:05 2022] POST /compute/v2.1/servers/9777f592-2e10-475d-b716-a98d5f1c3c4d/os-volume_attachments => generated 194 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:00:06.855361 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-ac27fc87-7232-4db1-a743-1f40b5f5a97b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:06.856099 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-ac27fc87-7232-4db1-a743-1f40b5f5a97b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:00:06.858402 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_api:SELECT=30 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:00:06.863758 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ac27fc87-7232-4db1-a743-1f40b5f5a97b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:06.864253 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ac27fc87-7232-4db1-a743-1f40b5f5a97b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:06.864695 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ac27fc87-7232-4db1-a743-1f40b5f5a97b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:06.865395 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ac27fc87-7232-4db1-a743-1f40b5f5a97b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:06.865888 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ac27fc87-7232-4db1-a743-1f40b5f5a97b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:06.866441 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ac27fc87-7232-4db1-a743-1f40b5f5a97b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:07.004754 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-ac27fc87-7232-4db1-a743-1f40b5f5a97b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:07.016626 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-ac27fc87-7232-4db1-a743-1f40b5f5a97b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:07.018892 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-ac27fc87-7232-4db1-a743-1f40b5f5a97b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:07.020109 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-ac27fc87-7232-4db1-a743-1f40b5f5a97b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6" status: 200 len: 1738 microversion: 2.20 time: 0.168654 Oct 17 04:00:07.023474 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 459/913] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 04:00:06 2022] GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6 => generated 1738 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:00:08.051148 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-50044045-4337-4654-a084-b684a93f9d04 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:08.051998 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-50044045-4337-4654-a084-b684a93f9d04 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:00:08.058801 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-50044045-4337-4654-a084-b684a93f9d04 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:08.061658 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-50044045-4337-4654-a084-b684a93f9d04 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:08.062146 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-50044045-4337-4654-a084-b684a93f9d04 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:08.062971 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-50044045-4337-4654-a084-b684a93f9d04 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:08.063522 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-50044045-4337-4654-a084-b684a93f9d04 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:08.064164 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-50044045-4337-4654-a084-b684a93f9d04 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:08.224529 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-50044045-4337-4654-a084-b684a93f9d04 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:08.233127 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-50044045-4337-4654-a084-b684a93f9d04 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:08.235038 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-50044045-4337-4654-a084-b684a93f9d04 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:08.236501 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-50044045-4337-4654-a084-b684a93f9d04 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6" status: 200 len: 1738 microversion: 2.20 time: 0.190236 Oct 17 04:00:08.237774 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 455/914] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 04:00:08 2022] GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6 => generated 1738 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 04:00:08.643728 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-ed52ff99-e6f9-44e9-97db-6505d90f542d tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:08.644882 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-ed52ff99-e6f9-44e9-97db-6505d90f542d tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 9777f592-2e10-475d-b716-a98d5f1c3c4d] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:00:08.650923 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ed52ff99-e6f9-44e9-97db-6505d90f542d tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:08.651457 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ed52ff99-e6f9-44e9-97db-6505d90f542d tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:08.651899 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ed52ff99-e6f9-44e9-97db-6505d90f542d tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:08.652595 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ed52ff99-e6f9-44e9-97db-6505d90f542d tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:08.653049 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ed52ff99-e6f9-44e9-97db-6505d90f542d tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:08.653478 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ed52ff99-e6f9-44e9-97db-6505d90f542d tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:08.801936 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.objects.instance [None req-ed52ff99-e6f9-44e9-97db-6505d90f542d tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lazy-loading 'services' on Instance uuid 9777f592-2e10-475d-b716-a98d5f1c3c4d {{(pid=125871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 04:00:09.074078 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-ed52ff99-e6f9-44e9-97db-6505d90f542d tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9777f592-2e10-475d-b716-a98d5f1c3c4d/os-volume_attachments/301dfb9f-ade8-4729-b8ba-c4ad8f49ab86" status: 202 len: 0 microversion: 2.1 time: 0.434568 Oct 17 04:00:09.075274 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 460/915] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Oct 17 04:00:08 2022] DELETE /compute/v2.1/servers/9777f592-2e10-475d-b716-a98d5f1c3c4d/os-volume_attachments/301dfb9f-ade8-4729-b8ba-c4ad8f49ab86 => generated 0 bytes in 437 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 04:00:09.083594 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-853e7cf7-d4ca-4d65-8b04-9b7104318432 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:09.085855 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-853e7cf7-d4ca-4d65-8b04-9b7104318432 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 9777f592-2e10-475d-b716-a98d5f1c3c4d] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:00:09.093297 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-853e7cf7-d4ca-4d65-8b04-9b7104318432 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:09.094074 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-853e7cf7-d4ca-4d65-8b04-9b7104318432 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:09.094512 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-853e7cf7-d4ca-4d65-8b04-9b7104318432 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:09.103730 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-853e7cf7-d4ca-4d65-8b04-9b7104318432 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:09.103730 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-853e7cf7-d4ca-4d65-8b04-9b7104318432 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:09.114483 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-853e7cf7-d4ca-4d65-8b04-9b7104318432 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:09.137070 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-853e7cf7-d4ca-4d65-8b04-9b7104318432 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/9777f592-2e10-475d-b716-a98d5f1c3c4d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057377 Oct 17 04:00:09.137659 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 456/916] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 17 04:00:09 2022] GET /compute/v2.1/servers/9777f592-2e10-475d-b716-a98d5f1c3c4d/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:00:09.266292 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-536a203f-aabf-4ad1-b9e0-496d1630321b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:09.267271 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-536a203f-aabf-4ad1-b9e0-496d1630321b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:00:09.283058 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-536a203f-aabf-4ad1-b9e0-496d1630321b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:09.289078 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-536a203f-aabf-4ad1-b9e0-496d1630321b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:09.289537 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-536a203f-aabf-4ad1-b9e0-496d1630321b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:09.290274 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-536a203f-aabf-4ad1-b9e0-496d1630321b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:09.292286 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-536a203f-aabf-4ad1-b9e0-496d1630321b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:09.292286 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-536a203f-aabf-4ad1-b9e0-496d1630321b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:09.487338 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-536a203f-aabf-4ad1-b9e0-496d1630321b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:09.496364 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-536a203f-aabf-4ad1-b9e0-496d1630321b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:09.498669 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-536a203f-aabf-4ad1-b9e0-496d1630321b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:09.506861 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-536a203f-aabf-4ad1-b9e0-496d1630321b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6" status: 200 len: 1738 microversion: 2.20 time: 0.245880 Oct 17 04:00:09.507702 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 461/917] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 04:00:09 2022] GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6 => generated 1738 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:00:10.149311 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-a83b66c7-7b83-4b8a-841f-6a6cfb5125e8 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:10.151477 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-a83b66c7-7b83-4b8a-841f-6a6cfb5125e8 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 9777f592-2e10-475d-b716-a98d5f1c3c4d] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:00:10.162704 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a83b66c7-7b83-4b8a-841f-6a6cfb5125e8 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:10.163216 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a83b66c7-7b83-4b8a-841f-6a6cfb5125e8 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:10.163649 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a83b66c7-7b83-4b8a-841f-6a6cfb5125e8 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:10.164507 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a83b66c7-7b83-4b8a-841f-6a6cfb5125e8 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:10.171690 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a83b66c7-7b83-4b8a-841f-6a6cfb5125e8 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:10.171690 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a83b66c7-7b83-4b8a-841f-6a6cfb5125e8 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:10.171690 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:00:10.196375 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-a83b66c7-7b83-4b8a-841f-6a6cfb5125e8 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/9777f592-2e10-475d-b716-a98d5f1c3c4d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051007 Oct 17 04:00:10.196924 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 457/918] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 17 04:00:10 2022] GET /compute/v2.1/servers/9777f592-2e10-475d-b716-a98d5f1c3c4d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:00:10.536245 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-5531d0ad-549d-442b-995f-0db21a3985da tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:10.537734 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-5531d0ad-549d-442b-995f-0db21a3985da tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:00:10.544734 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5531d0ad-549d-442b-995f-0db21a3985da tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:10.546186 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5531d0ad-549d-442b-995f-0db21a3985da tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:10.546622 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5531d0ad-549d-442b-995f-0db21a3985da tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:10.547739 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5531d0ad-549d-442b-995f-0db21a3985da tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:10.548252 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5531d0ad-549d-442b-995f-0db21a3985da tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:10.548907 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-5531d0ad-549d-442b-995f-0db21a3985da tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:10.722883 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-5531d0ad-549d-442b-995f-0db21a3985da tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:10.732842 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-5531d0ad-549d-442b-995f-0db21a3985da tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:10.734710 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-5531d0ad-549d-442b-995f-0db21a3985da tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:10.736510 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-5531d0ad-549d-442b-995f-0db21a3985da tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6" status: 200 len: 1738 microversion: 2.20 time: 0.204751 Oct 17 04:00:10.756453 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 462/919] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 04:00:10 2022] GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6 => generated 1738 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:00:11.210921 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-bf261be8-9d73-4d16-ab81-cd9c59c9e2b6 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:11.213142 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-bf261be8-9d73-4d16-ab81-cd9c59c9e2b6 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 9777f592-2e10-475d-b716-a98d5f1c3c4d] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:00:11.220846 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-bf261be8-9d73-4d16-ab81-cd9c59c9e2b6 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:11.221538 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-bf261be8-9d73-4d16-ab81-cd9c59c9e2b6 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:11.222270 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-bf261be8-9d73-4d16-ab81-cd9c59c9e2b6 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:11.223459 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-bf261be8-9d73-4d16-ab81-cd9c59c9e2b6 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:11.224345 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-bf261be8-9d73-4d16-ab81-cd9c59c9e2b6 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:11.224855 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-bf261be8-9d73-4d16-ab81-cd9c59c9e2b6 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:11.259647 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-bf261be8-9d73-4d16-ab81-cd9c59c9e2b6 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/9777f592-2e10-475d-b716-a98d5f1c3c4d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053775 Oct 17 04:00:11.260420 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 458/920] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 17 04:00:11 2022] GET /compute/v2.1/servers/9777f592-2e10-475d-b716-a98d5f1c3c4d/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 04:00:11.330060 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-be5035d8-ec31-4512-9354-6e2017766771 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:11.330555 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-be5035d8-ec31-4512-9354-6e2017766771 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 9777f592-2e10-475d-b716-a98d5f1c3c4d] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:00:11.342948 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-be5035d8-ec31-4512-9354-6e2017766771 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:11.343465 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-be5035d8-ec31-4512-9354-6e2017766771 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:11.343904 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-be5035d8-ec31-4512-9354-6e2017766771 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:11.344672 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-be5035d8-ec31-4512-9354-6e2017766771 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:11.345057 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-be5035d8-ec31-4512-9354-6e2017766771 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:11.345483 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-be5035d8-ec31-4512-9354-6e2017766771 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:11.384929 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-be5035d8-ec31-4512-9354-6e2017766771 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 9777f592-2e10-475d-b716-a98d5f1c3c4d] Going to try to terminate instance {{(pid=125871) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 04:00:11.815313 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-be5035d8-ec31-4512-9354-6e2017766771 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9777f592-2e10-475d-b716-a98d5f1c3c4d" status: 204 len: 0 microversion: 2.1 time: 0.487851 Oct 17 04:00:11.816717 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 463/921] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 17 04:00:11 2022] DELETE /compute/v2.1/servers/9777f592-2e10-475d-b716-a98d5f1c3c4d => generated 0 bytes in 491 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 04:00:11.826216 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-7d50467c-8d72-4cd5-964a-85266b83404b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:11.827118 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-7d50467c-8d72-4cd5-964a-85266b83404b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 9777f592-2e10-475d-b716-a98d5f1c3c4d] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:00:11.838862 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7d50467c-8d72-4cd5-964a-85266b83404b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:11.840986 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7d50467c-8d72-4cd5-964a-85266b83404b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:11.842947 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7d50467c-8d72-4cd5-964a-85266b83404b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:11.843917 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7d50467c-8d72-4cd5-964a-85266b83404b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:11.845220 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7d50467c-8d72-4cd5-964a-85266b83404b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:11.847780 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7d50467c-8d72-4cd5-964a-85266b83404b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:12.018683 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-7d50467c-8d72-4cd5-964a-85266b83404b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:12.028437 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-7d50467c-8d72-4cd5-964a-85266b83404b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/9777f592-2e10-475d-b716-a98d5f1c3c4d" status: 200 len: 1684 microversion: 2.1 time: 0.207116 Oct 17 04:00:12.030337 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 464/922] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 04:00:11 2022] GET /compute/v2.1/servers/9777f592-2e10-475d-b716-a98d5f1c3c4d => generated 1684 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:00:12.066558 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-eabc65ae-171f-4eca-be56-7c31dcec9565 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:12.067198 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-eabc65ae-171f-4eca-be56-7c31dcec9565 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:00:12.073914 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-eabc65ae-171f-4eca-be56-7c31dcec9565 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:12.074327 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-eabc65ae-171f-4eca-be56-7c31dcec9565 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:12.074976 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-eabc65ae-171f-4eca-be56-7c31dcec9565 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:12.075739 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-eabc65ae-171f-4eca-be56-7c31dcec9565 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:12.076188 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-eabc65ae-171f-4eca-be56-7c31dcec9565 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:12.076675 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-eabc65ae-171f-4eca-be56-7c31dcec9565 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:12.234901 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-eabc65ae-171f-4eca-be56-7c31dcec9565 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:12.244858 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-eabc65ae-171f-4eca-be56-7c31dcec9565 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:12.246613 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-eabc65ae-171f-4eca-be56-7c31dcec9565 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:12.248071 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-eabc65ae-171f-4eca-be56-7c31dcec9565 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6" status: 200 len: 1738 microversion: 2.20 time: 0.489805 Oct 17 04:00:12.248905 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 459/923] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 04:00:11 2022] GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6 => generated 1738 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 04:00:13.054657 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-696270c9-a60f-48c0-bc10-88d95c34d1b8 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:13.056065 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-696270c9-a60f-48c0-bc10-88d95c34d1b8 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 9777f592-2e10-475d-b716-a98d5f1c3c4d] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:00:13.061929 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-696270c9-a60f-48c0-bc10-88d95c34d1b8 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:13.062411 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-696270c9-a60f-48c0-bc10-88d95c34d1b8 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:13.062846 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-696270c9-a60f-48c0-bc10-88d95c34d1b8 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:13.063572 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-696270c9-a60f-48c0-bc10-88d95c34d1b8 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:13.064033 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-696270c9-a60f-48c0-bc10-88d95c34d1b8 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:13.064459 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-696270c9-a60f-48c0-bc10-88d95c34d1b8 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:13.202682 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-696270c9-a60f-48c0-bc10-88d95c34d1b8 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:13.210794 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-696270c9-a60f-48c0-bc10-88d95c34d1b8 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/9777f592-2e10-475d-b716-a98d5f1c3c4d" status: 200 len: 1684 microversion: 2.1 time: 0.160696 Oct 17 04:00:13.211403 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 465/924] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 04:00:13 2022] GET /compute/v2.1/servers/9777f592-2e10-475d-b716-a98d5f1c3c4d => generated 1684 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:00:13.277617 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-7e7d4b93-279f-4308-8019-c75a0ce2d51a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:13.278420 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-7e7d4b93-279f-4308-8019-c75a0ce2d51a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:00:13.286162 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-7e7d4b93-279f-4308-8019-c75a0ce2d51a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:13.286640 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-7e7d4b93-279f-4308-8019-c75a0ce2d51a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:13.287069 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-7e7d4b93-279f-4308-8019-c75a0ce2d51a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:13.287821 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-7e7d4b93-279f-4308-8019-c75a0ce2d51a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:13.288389 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-7e7d4b93-279f-4308-8019-c75a0ce2d51a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:13.288840 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-7e7d4b93-279f-4308-8019-c75a0ce2d51a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:13.434339 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-7e7d4b93-279f-4308-8019-c75a0ce2d51a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:13.442508 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-7e7d4b93-279f-4308-8019-c75a0ce2d51a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:13.444013 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-7e7d4b93-279f-4308-8019-c75a0ce2d51a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:13.445300 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-7e7d4b93-279f-4308-8019-c75a0ce2d51a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6" status: 200 len: 1738 microversion: 2.20 time: 0.172686 Oct 17 04:00:13.445869 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 460/925] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 04:00:13 2022] GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6 => generated 1738 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:00:14.236849 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-153e5877-af76-49f2-b56b-1d3d70f55810 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:14.237526 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-153e5877-af76-49f2-b56b-1d3d70f55810 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 9777f592-2e10-475d-b716-a98d5f1c3c4d] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:00:14.244286 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-153e5877-af76-49f2-b56b-1d3d70f55810 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:14.244922 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-153e5877-af76-49f2-b56b-1d3d70f55810 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:14.245652 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-153e5877-af76-49f2-b56b-1d3d70f55810 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:14.249498 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-153e5877-af76-49f2-b56b-1d3d70f55810 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:14.250088 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-153e5877-af76-49f2-b56b-1d3d70f55810 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:14.250638 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-153e5877-af76-49f2-b56b-1d3d70f55810 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:14.320126 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-153e5877-af76-49f2-b56b-1d3d70f55810 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:14.330241 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-153e5877-af76-49f2-b56b-1d3d70f55810 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/9777f592-2e10-475d-b716-a98d5f1c3c4d" status: 200 len: 1616 microversion: 2.1 time: 0.096022 Oct 17 04:00:14.330241 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 466/926] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 04:00:14 2022] GET /compute/v2.1/servers/9777f592-2e10-475d-b716-a98d5f1c3c4d => generated 1616 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:00:14.477811 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-1fcbd160-8d58-42b6-9cea-bc0071d320e2 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:14.477811 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-1fcbd160-8d58-42b6-9cea-bc0071d320e2 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:00:14.479322 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1fcbd160-8d58-42b6-9cea-bc0071d320e2 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:14.480386 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1fcbd160-8d58-42b6-9cea-bc0071d320e2 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:14.481007 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1fcbd160-8d58-42b6-9cea-bc0071d320e2 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:14.482354 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1fcbd160-8d58-42b6-9cea-bc0071d320e2 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:14.483146 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1fcbd160-8d58-42b6-9cea-bc0071d320e2 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:14.483938 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1fcbd160-8d58-42b6-9cea-bc0071d320e2 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:14.523726 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [req-fb75fe16-06d8-4e66-9d32-04a216f78ebf req-8a0781b9-c36b-4bfd-acd5-6f678645fc06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9777f592-2e10-475d-b716-a98d5f1c3c4d", "name": "network-vif-deleted", "tag": "b0a9dc4c-de2f-487a-acd6-cca8d9d40807"}]} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:00:14.542366 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-fb75fe16-06d8-4e66-9d32-04a216f78ebf req-8a0781b9-c36b-4bfd-acd5-6f678645fc06 service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:14.546174 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-fb75fe16-06d8-4e66-9d32-04a216f78ebf req-8a0781b9-c36b-4bfd-acd5-6f678645fc06 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:14.546910 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-fb75fe16-06d8-4e66-9d32-04a216f78ebf req-8a0781b9-c36b-4bfd-acd5-6f678645fc06 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:14.572041 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.compute.server_external_events [req-fb75fe16-06d8-4e66-9d32-04a216f78ebf req-8a0781b9-c36b-4bfd-acd5-6f678645fc06 service nova] Creating event network-vif-deleted:b0a9dc4c-de2f-487a-acd6-cca8d9d40807 for instance 9777f592-2e10-475d-b716-a98d5f1c3c4d on hv-cinder-81558 Oct 17 04:00:14.584663 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [req-fb75fe16-06d8-4e66-9d32-04a216f78ebf req-8a0781b9-c36b-4bfd-acd5-6f678645fc06 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067675 Oct 17 04:00:14.586342 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 467/927] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 04:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:00:14.714868 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-1fcbd160-8d58-42b6-9cea-bc0071d320e2 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:14.723685 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-1fcbd160-8d58-42b6-9cea-bc0071d320e2 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:14.726342 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-1fcbd160-8d58-42b6-9cea-bc0071d320e2 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:14.727856 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-1fcbd160-8d58-42b6-9cea-bc0071d320e2 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6" status: 200 len: 1738 microversion: 2.20 time: 0.260435 Oct 17 04:00:14.728529 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 461/928] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 04:00:14 2022] GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6 => generated 1738 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 04:00:15.354114 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-1decb74f-c613-42b2-b01d-e4c0e378493b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:15.356387 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-1decb74f-c613-42b2-b01d-e4c0e378493b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 9777f592-2e10-475d-b716-a98d5f1c3c4d] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:00:15.366677 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1decb74f-c613-42b2-b01d-e4c0e378493b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:15.367194 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1decb74f-c613-42b2-b01d-e4c0e378493b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:15.370868 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1decb74f-c613-42b2-b01d-e4c0e378493b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:15.371569 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1decb74f-c613-42b2-b01d-e4c0e378493b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:15.372039 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1decb74f-c613-42b2-b01d-e4c0e378493b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:15.372613 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1decb74f-c613-42b2-b01d-e4c0e378493b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:15.426105 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1decb74f-c613-42b2-b01d-e4c0e378493b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:15.426776 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1decb74f-c613-42b2-b01d-e4c0e378493b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:15.427404 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-1decb74f-c613-42b2-b01d-e4c0e378493b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:15.428006 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.objects.instance [None req-1decb74f-c613-42b2-b01d-e4c0e378493b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lazy-loading 'fault' on Instance uuid 9777f592-2e10-475d-b716-a98d5f1c3c4d {{(pid=125871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 04:00:15.480671 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-1decb74f-c613-42b2-b01d-e4c0e378493b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ac14bb6ceb4d9a92a20938e9688bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af3ce80f169473882a247ba78d3d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:15.494898 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-1decb74f-c613-42b2-b01d-e4c0e378493b tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/9777f592-2e10-475d-b716-a98d5f1c3c4d" status: 200 len: 1332 microversion: 2.1 time: 0.146174 Oct 17 04:00:15.495515 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 468/929] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 04:00:15 2022] GET /compute/v2.1/servers/9777f592-2e10-475d-b716-a98d5f1c3c4d => generated 1332 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:00:15.762367 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-54364e7c-87b6-49c1-b540-882e34a194b5 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:15.762367 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-54364e7c-87b6-49c1-b540-882e34a194b5 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:00:15.768953 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-54364e7c-87b6-49c1-b540-882e34a194b5 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:15.769448 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-54364e7c-87b6-49c1-b540-882e34a194b5 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:15.769866 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-54364e7c-87b6-49c1-b540-882e34a194b5 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:15.770759 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-54364e7c-87b6-49c1-b540-882e34a194b5 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:15.771268 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-54364e7c-87b6-49c1-b540-882e34a194b5 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:15.771703 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-54364e7c-87b6-49c1-b540-882e34a194b5 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:15.998044 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-54364e7c-87b6-49c1-b540-882e34a194b5 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:16.007461 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-54364e7c-87b6-49c1-b540-882e34a194b5 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:16.009005 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-54364e7c-87b6-49c1-b540-882e34a194b5 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:16.010370 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-54364e7c-87b6-49c1-b540-882e34a194b5 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6" status: 200 len: 1720 microversion: 2.20 time: 0.253349 Oct 17 04:00:16.011007 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 462/930] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 04:00:15 2022] GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6 => generated 1720 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:00:16.068078 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [req-f48b7da8-170a-48e2-b95b-e5790f459b4b req-94bcffb6-6a4c-4119-beb5-18589d75db1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5d69048-2557-4e13-92de-3381030814e6", "name": "network-vif-unplugged", "status": "completed", "tag": "4983815b-2774-4cc1-a815-084c70865641"}]} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:00:16.078617 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-f48b7da8-170a-48e2-b95b-e5790f459b4b req-94bcffb6-6a4c-4119-beb5-18589d75db1e service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:16.079373 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-f48b7da8-170a-48e2-b95b-e5790f459b4b req-94bcffb6-6a4c-4119-beb5-18589d75db1e service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:16.085892 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-f48b7da8-170a-48e2-b95b-e5790f459b4b req-94bcffb6-6a4c-4119-beb5-18589d75db1e service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:16.089421 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:00:16.099939 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.compute.server_external_events [req-f48b7da8-170a-48e2-b95b-e5790f459b4b req-94bcffb6-6a4c-4119-beb5-18589d75db1e service nova] Creating event network-vif-unplugged:4983815b-2774-4cc1-a815-084c70865641 for instance e5d69048-2557-4e13-92de-3381030814e6 on hv-cinder-81558 Oct 17 04:00:16.105089 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [req-f48b7da8-170a-48e2-b95b-e5790f459b4b req-94bcffb6-6a4c-4119-beb5-18589d75db1e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042058 Oct 17 04:00:16.105684 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 469/931] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 04:00:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:00:16.523690 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-61a4d3e1-c2e8-4314-8ee9-28740613234f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:16.524565 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-61a4d3e1-c2e8-4314-8ee9-28740613234f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 9777f592-2e10-475d-b716-a98d5f1c3c4d] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:00:16.530555 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-61a4d3e1-c2e8-4314-8ee9-28740613234f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:16.531053 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-61a4d3e1-c2e8-4314-8ee9-28740613234f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:16.531626 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-61a4d3e1-c2e8-4314-8ee9-28740613234f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:16.532314 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-61a4d3e1-c2e8-4314-8ee9-28740613234f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:16.532761 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-61a4d3e1-c2e8-4314-8ee9-28740613234f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:16.533371 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-61a4d3e1-c2e8-4314-8ee9-28740613234f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:16.547012 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.wsgi [None req-61a4d3e1-c2e8-4314-8ee9-28740613234f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] HTTP exception thrown: Instance 9777f592-2e10-475d-b716-a98d5f1c3c4d could not be found. Oct 17 04:00:16.548680 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-61a4d3e1-c2e8-4314-8ee9-28740613234f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Request method failure captured: Oct 17 04:00:16.548680 dv-cinder-815582-16-smb devstack@n-api.service[125872]: request: GET /compute/v2.1/servers/9777f592-2e10-475d-b716-a98d5f1c3c4d HTTP/1.1 Oct 17 04:00:16.548680 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Accept: application/json Oct 17 04:00:16.548680 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Accept-Encoding: identity Oct 17 04:00:16.548680 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Connection: close Oct 17 04:00:16.548680 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Content-Length: 0 Oct 17 04:00:16.548680 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Content-Type: application/json Oct 17 04:00:16.548680 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Host: 10.222.0.16 Oct 17 04:00:16.548680 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Openstack-System-Scope: None Oct 17 04:00:16.548680 dv-cinder-815582-16-smb devstack@n-api.service[125872]: User-Agent: python-urllib3/1.26.12 Oct 17 04:00:16.548680 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Auth-Token: gAAAAABjTNHS-JkBpYGlE8smCEkK5jojHou0K6VK_tNmdNYF8mJS0isG5A2O-CJO1Z0ixcowhaVCDpWbdKHf1nvQBjXwKqEHeDqSudyXAc3IKeNiaKgebnu28MS5PTi1Pi3TKRwLiMEjkJOln2AC5NFbphJ0QfPkQ085FD6azHU6IqdftqedhcI Oct 17 04:00:16.548680 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Domain-Id: None Oct 17 04:00:16.548680 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Domain-Name: None Oct 17 04:00:16.548680 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Identity-Status: Confirmed Oct 17 04:00:16.548680 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Is-Admin-Project: True Oct 17 04:00:16.548680 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Domain-Id: default Oct 17 04:00:16.548680 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Domain-Name: Default Oct 17 04:00:16.548680 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Id: 8af3ce80f169473882a247ba78d3d6ef Oct 17 04:00:16.548680 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Name: tempest-AttachVolumeNegativeTest-973579303 Oct 17 04:00:16.548680 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Role: reader,member Oct 17 04:00:16.548680 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Roles: reader,member Oct 17 04:00:16.550780 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8af3ce80f169473882a247ba78d3d6ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8af3ce80f169473882a247ba78d3d6ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8af3ce80f169473882a247ba78d3d6ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8af3ce80f169473882a247ba78d3d6ef", "adminURL": "http://10.222.0.16:8080"}]}] Oct 17 04:00:16.550780 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant: tempest-AttachVolumeNegativeTest-973579303 Oct 17 04:00:16.550780 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant-Id: 8af3ce80f169473882a247ba78d3d6ef Oct 17 04:00:16.550780 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-973579303 Oct 17 04:00:16.550780 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User: tempest-AttachVolumeNegativeTest-973579303-project Oct 17 04:00:16.550780 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Domain-Id: default Oct 17 04:00:16.550780 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Domain-Name: Default Oct 17 04:00:16.550780 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Id: e9ac14bb6ceb4d9a92a20938e9688bbd Oct 17 04:00:16.550780 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Name: tempest-AttachVolumeNegativeTest-973579303-project Oct 17 04:00:16.550780 dv-cinder-815582-16-smb devstack@n-api.service[125872]: method: > Oct 17 04:00:16.550780 dv-cinder-815582-16-smb devstack@n-api.service[125872]: exception: Instance 9777f592-2e10-475d-b716-a98d5f1c3c4d could not be found. Oct 17 04:00:16.550780 dv-cinder-815582-16-smb devstack@n-api.service[125872]: action_args: {'id': '9777f592-2e10-475d-b716-a98d5f1c3c4d'} Oct 17 04:00:16.551682 dv-cinder-815582-16-smb devstack@n-api.service[125872]: {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:00:16.551682 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:00:16.551682 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 04:00:16.551682 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 04:00:16.551682 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 04:00:16.551682 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 04:00:16.551682 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 04:00:16.551682 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 04:00:16.551682 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 04:00:16.551682 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 04:00:16.551682 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9777f592-2e10-475d-b716-a98d5f1c3c4d could not be found. Oct 17 04:00:16.551682 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 04:00:16.551682 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:00:16.551682 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 04:00:16.551682 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:00:16.551682 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:00:16.551682 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:00:16.551682 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:00:16.551682 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:00:16.551682 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:00:16.552969 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:00:16.552969 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 04:00:16.552969 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 04:00:16.552969 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 04:00:16.552969 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 04:00:16.552969 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 04:00:16.552969 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:00:16.552969 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9777f592-2e10-475d-b716-a98d5f1c3c4d could not be found. Oct 17 04:00:16.552969 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 04:00:16.552969 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:00:16.552969 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 04:00:16.552969 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:00:16.552969 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:00:16.552969 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:00:16.552969 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:00:16.552969 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:00:16.552969 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9777f592-2e10-475d-b716-a98d5f1c3c4d could not be found. Oct 17 04:00:16.552969 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 04:00:16.554173 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-61a4d3e1-c2e8-4314-8ee9-28740613234f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Returning 404 to user: Instance 9777f592-2e10-475d-b716-a98d5f1c3c4d could not be found. {{(pid=125872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:00:16.554173 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-61a4d3e1-c2e8-4314-8ee9-28740613234f tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/9777f592-2e10-475d-b716-a98d5f1c3c4d" status: 404 len: 111 microversion: 2.1 time: 0.030250 Oct 17 04:00:16.554173 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 463/932] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 04:00:16 2022] GET /compute/v2.1/servers/9777f592-2e10-475d-b716-a98d5f1c3c4d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 04:00:16.560029 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-72c9e919-7632-41b3-981c-6638c34c6770 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '.version_select at 0x7fd72bb71ca0>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:16.669949 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-72c9e919-7632-41b3-981c-6638c34c6770 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1864344103" status: 202 len: 0 microversion: 2.1 time: 0.113973 Oct 17 04:00:16.673938 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 470/933] 10.222.0.16 () {58 vars in 1221 bytes} [Mon Oct 17 04:00:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1864344103 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 04:00:17.038937 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-8c94a668-6bae-4d45-94ed-cd6cc2f01e15 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:17.040134 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-8c94a668-6bae-4d45-94ed-cd6cc2f01e15 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:00:17.046783 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8c94a668-6bae-4d45-94ed-cd6cc2f01e15 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:17.047298 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8c94a668-6bae-4d45-94ed-cd6cc2f01e15 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:17.047869 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8c94a668-6bae-4d45-94ed-cd6cc2f01e15 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:17.048575 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8c94a668-6bae-4d45-94ed-cd6cc2f01e15 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:17.049031 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8c94a668-6bae-4d45-94ed-cd6cc2f01e15 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:17.049452 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8c94a668-6bae-4d45-94ed-cd6cc2f01e15 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:17.206822 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-8c94a668-6bae-4d45-94ed-cd6cc2f01e15 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:17.215532 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-8c94a668-6bae-4d45-94ed-cd6cc2f01e15 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:17.217078 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-8c94a668-6bae-4d45-94ed-cd6cc2f01e15 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:17.218525 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-8c94a668-6bae-4d45-94ed-cd6cc2f01e15 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6" status: 200 len: 1720 microversion: 2.20 time: 0.184154 Oct 17 04:00:17.219152 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 464/934] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 04:00:17 2022] GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6 => generated 1720 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 04:00:18.245222 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-7a34a146-adbf-42a2-be11-d2e44feb6a2f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:18.245967 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-7a34a146-adbf-42a2-be11-d2e44feb6a2f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:00:18.253835 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7a34a146-adbf-42a2-be11-d2e44feb6a2f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:18.254334 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7a34a146-adbf-42a2-be11-d2e44feb6a2f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:18.254847 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7a34a146-adbf-42a2-be11-d2e44feb6a2f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:18.255621 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7a34a146-adbf-42a2-be11-d2e44feb6a2f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:18.256086 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7a34a146-adbf-42a2-be11-d2e44feb6a2f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:18.256537 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-7a34a146-adbf-42a2-be11-d2e44feb6a2f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:18.396490 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-7a34a146-adbf-42a2-be11-d2e44feb6a2f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:18.404892 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-7a34a146-adbf-42a2-be11-d2e44feb6a2f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:18.406371 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-7a34a146-adbf-42a2-be11-d2e44feb6a2f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:18.407607 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-7a34a146-adbf-42a2-be11-d2e44feb6a2f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6" status: 200 len: 1723 microversion: 2.20 time: 0.167274 Oct 17 04:00:18.408173 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 471/935] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 04:00:18 2022] GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:00:18.432647 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-2f30728b-4ef5-4b65-a41a-fa21f1bf609f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "372b0566-b7fb-46fe-b038-a9ddf1730978"}} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:00:18.435108 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-2f30728b-4ef5-4b65-a41a-fa21f1bf609f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:00:18.441852 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2f30728b-4ef5-4b65-a41a-fa21f1bf609f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:18.442343 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2f30728b-4ef5-4b65-a41a-fa21f1bf609f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:18.442808 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2f30728b-4ef5-4b65-a41a-fa21f1bf609f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:18.443574 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2f30728b-4ef5-4b65-a41a-fa21f1bf609f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:18.444034 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2f30728b-4ef5-4b65-a41a-fa21f1bf609f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:18.444458 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2f30728b-4ef5-4b65-a41a-fa21f1bf609f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:18.738812 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-8200d063-02e8-4c8d-8be8-5e380c9fe6fb tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:18.739344 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-8200d063-02e8-4c8d-8be8-5e380c9fe6fb tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 9777f592-2e10-475d-b716-a98d5f1c3c4d] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:00:18.745398 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8200d063-02e8-4c8d-8be8-5e380c9fe6fb tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:18.745893 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8200d063-02e8-4c8d-8be8-5e380c9fe6fb tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:18.746381 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8200d063-02e8-4c8d-8be8-5e380c9fe6fb tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:18.747046 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8200d063-02e8-4c8d-8be8-5e380c9fe6fb tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:18.747532 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8200d063-02e8-4c8d-8be8-5e380c9fe6fb tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:18.747961 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8200d063-02e8-4c8d-8be8-5e380c9fe6fb tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:18.762497 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.wsgi [None req-8200d063-02e8-4c8d-8be8-5e380c9fe6fb tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] HTTP exception thrown: Instance 9777f592-2e10-475d-b716-a98d5f1c3c4d could not be found. Oct 17 04:00:18.764239 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-8200d063-02e8-4c8d-8be8-5e380c9fe6fb tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Request method failure captured: Oct 17 04:00:18.764239 dv-cinder-815582-16-smb devstack@n-api.service[125871]: request: DELETE /compute/v2.1/servers/9777f592-2e10-475d-b716-a98d5f1c3c4d HTTP/1.1 Oct 17 04:00:18.764239 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Accept: application/json Oct 17 04:00:18.764239 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Accept-Encoding: identity Oct 17 04:00:18.764239 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Connection: close Oct 17 04:00:18.764239 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Content-Length: 0 Oct 17 04:00:18.764239 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Content-Type: application/json Oct 17 04:00:18.764239 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Host: 10.222.0.16 Oct 17 04:00:18.764239 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Openstack-System-Scope: None Oct 17 04:00:18.764239 dv-cinder-815582-16-smb devstack@n-api.service[125871]: User-Agent: python-urllib3/1.26.12 Oct 17 04:00:18.764239 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Auth-Token: gAAAAABjTNHS-JkBpYGlE8smCEkK5jojHou0K6VK_tNmdNYF8mJS0isG5A2O-CJO1Z0ixcowhaVCDpWbdKHf1nvQBjXwKqEHeDqSudyXAc3IKeNiaKgebnu28MS5PTi1Pi3TKRwLiMEjkJOln2AC5NFbphJ0QfPkQ085FD6azHU6IqdftqedhcI Oct 17 04:00:18.764239 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Domain-Id: None Oct 17 04:00:18.764239 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Domain-Name: None Oct 17 04:00:18.764239 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Identity-Status: Confirmed Oct 17 04:00:18.764239 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Is-Admin-Project: True Oct 17 04:00:18.764239 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Domain-Id: default Oct 17 04:00:18.764239 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Domain-Name: Default Oct 17 04:00:18.764239 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Id: 8af3ce80f169473882a247ba78d3d6ef Oct 17 04:00:18.764239 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Name: tempest-AttachVolumeNegativeTest-973579303 Oct 17 04:00:18.764239 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Role: reader,member Oct 17 04:00:18.764239 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Roles: reader,member Oct 17 04:00:18.766170 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8af3ce80f169473882a247ba78d3d6ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8af3ce80f169473882a247ba78d3d6ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8af3ce80f169473882a247ba78d3d6ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8af3ce80f169473882a247ba78d3d6ef", "adminURL": "http://10.222.0.16:8080"}]}] Oct 17 04:00:18.766170 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant: tempest-AttachVolumeNegativeTest-973579303 Oct 17 04:00:18.766170 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant-Id: 8af3ce80f169473882a247ba78d3d6ef Oct 17 04:00:18.766170 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-973579303 Oct 17 04:00:18.766170 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User: tempest-AttachVolumeNegativeTest-973579303-project Oct 17 04:00:18.766170 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Domain-Id: default Oct 17 04:00:18.766170 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Domain-Name: Default Oct 17 04:00:18.766170 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Id: e9ac14bb6ceb4d9a92a20938e9688bbd Oct 17 04:00:18.766170 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Name: tempest-AttachVolumeNegativeTest-973579303-project Oct 17 04:00:18.766170 dv-cinder-815582-16-smb devstack@n-api.service[125871]: method: > Oct 17 04:00:18.766170 dv-cinder-815582-16-smb devstack@n-api.service[125871]: exception: Instance 9777f592-2e10-475d-b716-a98d5f1c3c4d could not be found. Oct 17 04:00:18.766170 dv-cinder-815582-16-smb devstack@n-api.service[125871]: action_args: {'id': '9777f592-2e10-475d-b716-a98d5f1c3c4d'} Oct 17 04:00:18.767095 dv-cinder-815582-16-smb devstack@n-api.service[125871]: {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:00:18.767095 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:00:18.767095 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 04:00:18.767095 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 04:00:18.767095 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 04:00:18.767095 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 04:00:18.767095 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 04:00:18.767095 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 04:00:18.767095 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 04:00:18.767095 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 04:00:18.767095 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9777f592-2e10-475d-b716-a98d5f1c3c4d could not be found. Oct 17 04:00:18.767095 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 04:00:18.767095 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:00:18.767095 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 04:00:18.767095 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:00:18.767095 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:00:18.767095 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:00:18.767095 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:00:18.767095 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:00:18.767095 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:00:18.769248 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:00:18.769248 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 04:00:18.769248 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 04:00:18.769248 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 04:00:18.769248 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 04:00:18.769248 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 04:00:18.769248 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 04:00:18.769248 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 04:00:18.769248 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:00:18.769248 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9777f592-2e10-475d-b716-a98d5f1c3c4d could not be found. Oct 17 04:00:18.769248 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 04:00:18.769248 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:00:18.769248 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 04:00:18.769248 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:00:18.769248 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:00:18.769248 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:00:18.769248 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:00:18.769248 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:00:18.769248 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9777f592-2e10-475d-b716-a98d5f1c3c4d could not be found. Oct 17 04:00:18.769248 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 04:00:18.771027 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-8200d063-02e8-4c8d-8be8-5e380c9fe6fb tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Returning 404 to user: Instance 9777f592-2e10-475d-b716-a98d5f1c3c4d could not be found. {{(pid=125871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:00:18.771027 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-8200d063-02e8-4c8d-8be8-5e380c9fe6fb tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9777f592-2e10-475d-b716-a98d5f1c3c4d" status: 404 len: 111 microversion: 2.1 time: 0.030781 Oct 17 04:00:18.771027 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 472/936] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 17 04:00:18 2022] DELETE /compute/v2.1/servers/9777f592-2e10-475d-b716-a98d5f1c3c4d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 04:00:18.774828 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-609e1cc6-2020-4eb0-b0ab-03cffd643ca7 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:18.775467 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-609e1cc6-2020-4eb0-b0ab-03cffd643ca7 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 9777f592-2e10-475d-b716-a98d5f1c3c4d] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:00:18.781358 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-609e1cc6-2020-4eb0-b0ab-03cffd643ca7 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:18.781851 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-609e1cc6-2020-4eb0-b0ab-03cffd643ca7 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:18.786615 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-609e1cc6-2020-4eb0-b0ab-03cffd643ca7 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:18.786615 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-609e1cc6-2020-4eb0-b0ab-03cffd643ca7 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:18.786615 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-609e1cc6-2020-4eb0-b0ab-03cffd643ca7 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:18.786615 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-609e1cc6-2020-4eb0-b0ab-03cffd643ca7 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:18.797318 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.wsgi [None req-609e1cc6-2020-4eb0-b0ab-03cffd643ca7 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] HTTP exception thrown: Instance 9777f592-2e10-475d-b716-a98d5f1c3c4d could not be found. Oct 17 04:00:18.798865 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-609e1cc6-2020-4eb0-b0ab-03cffd643ca7 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Request method failure captured: Oct 17 04:00:18.798865 dv-cinder-815582-16-smb devstack@n-api.service[125871]: request: GET /compute/v2.1/servers/9777f592-2e10-475d-b716-a98d5f1c3c4d HTTP/1.1 Oct 17 04:00:18.798865 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Accept: application/json Oct 17 04:00:18.798865 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Accept-Encoding: identity Oct 17 04:00:18.798865 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Connection: close Oct 17 04:00:18.798865 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Content-Length: 0 Oct 17 04:00:18.798865 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Content-Type: application/json Oct 17 04:00:18.798865 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Host: 10.222.0.16 Oct 17 04:00:18.798865 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Openstack-System-Scope: None Oct 17 04:00:18.798865 dv-cinder-815582-16-smb devstack@n-api.service[125871]: User-Agent: python-urllib3/1.26.12 Oct 17 04:00:18.798865 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Auth-Token: gAAAAABjTNHS-JkBpYGlE8smCEkK5jojHou0K6VK_tNmdNYF8mJS0isG5A2O-CJO1Z0ixcowhaVCDpWbdKHf1nvQBjXwKqEHeDqSudyXAc3IKeNiaKgebnu28MS5PTi1Pi3TKRwLiMEjkJOln2AC5NFbphJ0QfPkQ085FD6azHU6IqdftqedhcI Oct 17 04:00:18.798865 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Domain-Id: None Oct 17 04:00:18.798865 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Domain-Name: None Oct 17 04:00:18.798865 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Identity-Status: Confirmed Oct 17 04:00:18.798865 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Is-Admin-Project: True Oct 17 04:00:18.798865 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Domain-Id: default Oct 17 04:00:18.798865 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Domain-Name: Default Oct 17 04:00:18.798865 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Id: 8af3ce80f169473882a247ba78d3d6ef Oct 17 04:00:18.798865 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Name: tempest-AttachVolumeNegativeTest-973579303 Oct 17 04:00:18.798865 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Role: reader,member Oct 17 04:00:18.798865 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Roles: reader,member Oct 17 04:00:18.800440 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8af3ce80f169473882a247ba78d3d6ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8af3ce80f169473882a247ba78d3d6ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8af3ce80f169473882a247ba78d3d6ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8af3ce80f169473882a247ba78d3d6ef", "adminURL": "http://10.222.0.16:8080"}]}] Oct 17 04:00:18.800440 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant: tempest-AttachVolumeNegativeTest-973579303 Oct 17 04:00:18.800440 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant-Id: 8af3ce80f169473882a247ba78d3d6ef Oct 17 04:00:18.800440 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-973579303 Oct 17 04:00:18.800440 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User: tempest-AttachVolumeNegativeTest-973579303-project Oct 17 04:00:18.800440 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Domain-Id: default Oct 17 04:00:18.800440 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Domain-Name: Default Oct 17 04:00:18.800440 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Id: e9ac14bb6ceb4d9a92a20938e9688bbd Oct 17 04:00:18.800440 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Name: tempest-AttachVolumeNegativeTest-973579303-project Oct 17 04:00:18.800440 dv-cinder-815582-16-smb devstack@n-api.service[125871]: method: > Oct 17 04:00:18.800440 dv-cinder-815582-16-smb devstack@n-api.service[125871]: exception: Instance 9777f592-2e10-475d-b716-a98d5f1c3c4d could not be found. Oct 17 04:00:18.800440 dv-cinder-815582-16-smb devstack@n-api.service[125871]: action_args: {'id': '9777f592-2e10-475d-b716-a98d5f1c3c4d'} Oct 17 04:00:18.801334 dv-cinder-815582-16-smb devstack@n-api.service[125871]: {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:00:18.801334 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:00:18.801334 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 04:00:18.801334 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 04:00:18.801334 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 04:00:18.801334 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 04:00:18.801334 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 04:00:18.801334 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 04:00:18.801334 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 04:00:18.801334 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 04:00:18.801334 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9777f592-2e10-475d-b716-a98d5f1c3c4d could not be found. Oct 17 04:00:18.801334 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 04:00:18.801334 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:00:18.801334 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 04:00:18.801334 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:00:18.801334 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:00:18.801334 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:00:18.801334 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:00:18.801334 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:00:18.801334 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:00:18.802935 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:00:18.802935 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 04:00:18.802935 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 04:00:18.802935 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 04:00:18.802935 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 04:00:18.802935 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 04:00:18.802935 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:00:18.802935 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9777f592-2e10-475d-b716-a98d5f1c3c4d could not be found. Oct 17 04:00:18.802935 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 04:00:18.802935 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:00:18.802935 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 04:00:18.802935 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:00:18.802935 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:00:18.802935 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:00:18.802935 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:00:18.802935 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:00:18.802935 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9777f592-2e10-475d-b716-a98d5f1c3c4d could not be found. Oct 17 04:00:18.802935 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 04:00:18.804450 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-609e1cc6-2020-4eb0-b0ab-03cffd643ca7 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Returning 404 to user: Instance 9777f592-2e10-475d-b716-a98d5f1c3c4d could not be found. {{(pid=125871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:00:18.804450 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-609e1cc6-2020-4eb0-b0ab-03cffd643ca7 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/9777f592-2e10-475d-b716-a98d5f1c3c4d" status: 404 len: 111 microversion: 2.1 time: 0.029047 Oct 17 04:00:18.804450 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 473/937] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 04:00:18 2022] GET /compute/v2.1/servers/9777f592-2e10-475d-b716-a98d5f1c3c4d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 04:00:19.538399 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-2f30728b-4ef5-4b65-a41a-fa21f1bf609f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "POST /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.109680 Oct 17 04:00:19.538955 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 465/938] 10.222.0.16 () {62 vars in 1364 bytes} [Mon Oct 17 04:00:18 2022] POST /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6/os-volume_attachments => generated 188 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 04:00:19.678681 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-b355db21-f472-4ebe-83ac-4c4d797e6b64 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:19.679167 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-b355db21-f472-4ebe-83ac-4c4d797e6b64 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:00:19.686152 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b355db21-f472-4ebe-83ac-4c4d797e6b64 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:19.686640 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b355db21-f472-4ebe-83ac-4c4d797e6b64 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:19.687074 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b355db21-f472-4ebe-83ac-4c4d797e6b64 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:19.687795 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b355db21-f472-4ebe-83ac-4c4d797e6b64 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:19.688266 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b355db21-f472-4ebe-83ac-4c4d797e6b64 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:19.688678 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b355db21-f472-4ebe-83ac-4c4d797e6b64 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:20.088773 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-98a16503-6222-4aba-bee3-7e4a688355ef tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:20.088891 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-98a16503-6222-4aba-bee3-7e4a688355ef tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 6dabcc62-4829-4f97-830f-e82af447faca] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:00:20.090655 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_api:SELECT=44 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:00:20.095701 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-98a16503-6222-4aba-bee3-7e4a688355ef tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:20.096288 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-98a16503-6222-4aba-bee3-7e4a688355ef tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:20.096688 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-98a16503-6222-4aba-bee3-7e4a688355ef tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:20.098071 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-98a16503-6222-4aba-bee3-7e4a688355ef tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:20.098554 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-98a16503-6222-4aba-bee3-7e4a688355ef tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:20.099001 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-98a16503-6222-4aba-bee3-7e4a688355ef tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:20.112429 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.wsgi [None req-98a16503-6222-4aba-bee3-7e4a688355ef tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] HTTP exception thrown: Instance 6dabcc62-4829-4f97-830f-e82af447faca could not be found. Oct 17 04:00:20.114095 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-98a16503-6222-4aba-bee3-7e4a688355ef tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Request method failure captured: Oct 17 04:00:20.114095 dv-cinder-815582-16-smb devstack@n-api.service[125872]: request: DELETE /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca HTTP/1.1 Oct 17 04:00:20.114095 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Accept: application/json Oct 17 04:00:20.114095 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Accept-Encoding: identity Oct 17 04:00:20.114095 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Connection: close Oct 17 04:00:20.114095 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Content-Length: 0 Oct 17 04:00:20.114095 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Content-Type: application/json Oct 17 04:00:20.114095 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Host: 10.222.0.16 Oct 17 04:00:20.114095 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Openstack-System-Scope: None Oct 17 04:00:20.114095 dv-cinder-815582-16-smb devstack@n-api.service[125872]: User-Agent: python-urllib3/1.26.12 Oct 17 04:00:20.114095 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Auth-Token: gAAAAABjTNHS-JkBpYGlE8smCEkK5jojHou0K6VK_tNmdNYF8mJS0isG5A2O-CJO1Z0ixcowhaVCDpWbdKHf1nvQBjXwKqEHeDqSudyXAc3IKeNiaKgebnu28MS5PTi1Pi3TKRwLiMEjkJOln2AC5NFbphJ0QfPkQ085FD6azHU6IqdftqedhcI Oct 17 04:00:20.114095 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Domain-Id: None Oct 17 04:00:20.114095 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Domain-Name: None Oct 17 04:00:20.114095 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Identity-Status: Confirmed Oct 17 04:00:20.114095 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Is-Admin-Project: True Oct 17 04:00:20.114095 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Domain-Id: default Oct 17 04:00:20.114095 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Domain-Name: Default Oct 17 04:00:20.114095 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Id: 8af3ce80f169473882a247ba78d3d6ef Oct 17 04:00:20.114095 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Name: tempest-AttachVolumeNegativeTest-973579303 Oct 17 04:00:20.114095 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Role: reader,member Oct 17 04:00:20.114095 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Roles: reader,member Oct 17 04:00:20.115462 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8af3ce80f169473882a247ba78d3d6ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8af3ce80f169473882a247ba78d3d6ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8af3ce80f169473882a247ba78d3d6ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8af3ce80f169473882a247ba78d3d6ef", "adminURL": "http://10.222.0.16:8080"}]}] Oct 17 04:00:20.115462 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant: tempest-AttachVolumeNegativeTest-973579303 Oct 17 04:00:20.115462 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant-Id: 8af3ce80f169473882a247ba78d3d6ef Oct 17 04:00:20.115462 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-973579303 Oct 17 04:00:20.115462 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User: tempest-AttachVolumeNegativeTest-973579303-project Oct 17 04:00:20.115462 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Domain-Id: default Oct 17 04:00:20.115462 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Domain-Name: Default Oct 17 04:00:20.115462 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Id: e9ac14bb6ceb4d9a92a20938e9688bbd Oct 17 04:00:20.115462 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Name: tempest-AttachVolumeNegativeTest-973579303-project Oct 17 04:00:20.115462 dv-cinder-815582-16-smb devstack@n-api.service[125872]: method: > Oct 17 04:00:20.115462 dv-cinder-815582-16-smb devstack@n-api.service[125872]: exception: Instance 6dabcc62-4829-4f97-830f-e82af447faca could not be found. Oct 17 04:00:20.115462 dv-cinder-815582-16-smb devstack@n-api.service[125872]: action_args: {'id': '6dabcc62-4829-4f97-830f-e82af447faca'} Oct 17 04:00:20.116269 dv-cinder-815582-16-smb devstack@n-api.service[125872]: {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:00:20.116269 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:00:20.116269 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 04:00:20.116269 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 04:00:20.116269 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 04:00:20.116269 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 04:00:20.116269 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 04:00:20.116269 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 04:00:20.116269 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 04:00:20.116269 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 04:00:20.116269 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dabcc62-4829-4f97-830f-e82af447faca could not be found. Oct 17 04:00:20.116269 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 04:00:20.116269 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:00:20.116269 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 04:00:20.116269 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:00:20.116269 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:00:20.116269 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:00:20.116269 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:00:20.116269 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:00:20.116269 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:00:20.117485 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:00:20.117485 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 04:00:20.117485 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 04:00:20.117485 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 04:00:20.117485 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 04:00:20.117485 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 04:00:20.117485 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 04:00:20.117485 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 04:00:20.117485 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:00:20.117485 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dabcc62-4829-4f97-830f-e82af447faca could not be found. Oct 17 04:00:20.117485 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 04:00:20.117485 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:00:20.117485 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 04:00:20.117485 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:00:20.117485 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:00:20.117485 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:00:20.117485 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:00:20.117485 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:00:20.117485 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dabcc62-4829-4f97-830f-e82af447faca could not be found. Oct 17 04:00:20.117485 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 04:00:20.118744 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-98a16503-6222-4aba-bee3-7e4a688355ef tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Returning 404 to user: Instance 6dabcc62-4829-4f97-830f-e82af447faca could not be found. {{(pid=125872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:00:20.118744 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-98a16503-6222-4aba-bee3-7e4a688355ef tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca" status: 404 len: 111 microversion: 2.1 time: 0.031091 Oct 17 04:00:20.118744 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 466/939] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 17 04:00:20 2022] DELETE /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 04:00:20.124406 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-57b476b9-4305-4e70-a36a-fe00ae3d2ace tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:20.125642 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-57b476b9-4305-4e70-a36a-fe00ae3d2ace tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 6dabcc62-4829-4f97-830f-e82af447faca] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:00:20.131279 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-57b476b9-4305-4e70-a36a-fe00ae3d2ace tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:20.131772 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-57b476b9-4305-4e70-a36a-fe00ae3d2ace tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:20.132238 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-57b476b9-4305-4e70-a36a-fe00ae3d2ace tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:20.132908 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-57b476b9-4305-4e70-a36a-fe00ae3d2ace tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:20.133366 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-57b476b9-4305-4e70-a36a-fe00ae3d2ace tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:20.133842 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-57b476b9-4305-4e70-a36a-fe00ae3d2ace tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:20.148947 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.wsgi [None req-57b476b9-4305-4e70-a36a-fe00ae3d2ace tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] HTTP exception thrown: Instance 6dabcc62-4829-4f97-830f-e82af447faca could not be found. Oct 17 04:00:20.151382 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-57b476b9-4305-4e70-a36a-fe00ae3d2ace tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Request method failure captured: Oct 17 04:00:20.151382 dv-cinder-815582-16-smb devstack@n-api.service[125872]: request: GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca HTTP/1.1 Oct 17 04:00:20.151382 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Accept: application/json Oct 17 04:00:20.151382 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Accept-Encoding: identity Oct 17 04:00:20.151382 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Connection: close Oct 17 04:00:20.151382 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Content-Length: 0 Oct 17 04:00:20.151382 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Content-Type: application/json Oct 17 04:00:20.151382 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Host: 10.222.0.16 Oct 17 04:00:20.151382 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Openstack-System-Scope: None Oct 17 04:00:20.151382 dv-cinder-815582-16-smb devstack@n-api.service[125872]: User-Agent: python-urllib3/1.26.12 Oct 17 04:00:20.151382 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Auth-Token: gAAAAABjTNHS-JkBpYGlE8smCEkK5jojHou0K6VK_tNmdNYF8mJS0isG5A2O-CJO1Z0ixcowhaVCDpWbdKHf1nvQBjXwKqEHeDqSudyXAc3IKeNiaKgebnu28MS5PTi1Pi3TKRwLiMEjkJOln2AC5NFbphJ0QfPkQ085FD6azHU6IqdftqedhcI Oct 17 04:00:20.151382 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Domain-Id: None Oct 17 04:00:20.151382 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Domain-Name: None Oct 17 04:00:20.151382 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Identity-Status: Confirmed Oct 17 04:00:20.151382 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Is-Admin-Project: True Oct 17 04:00:20.151382 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Domain-Id: default Oct 17 04:00:20.151382 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Domain-Name: Default Oct 17 04:00:20.151382 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Id: 8af3ce80f169473882a247ba78d3d6ef Oct 17 04:00:20.151382 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Name: tempest-AttachVolumeNegativeTest-973579303 Oct 17 04:00:20.151382 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Role: reader,member Oct 17 04:00:20.151382 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Roles: reader,member Oct 17 04:00:20.153120 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8af3ce80f169473882a247ba78d3d6ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8af3ce80f169473882a247ba78d3d6ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8af3ce80f169473882a247ba78d3d6ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8af3ce80f169473882a247ba78d3d6ef", "adminURL": "http://10.222.0.16:8080"}]}] Oct 17 04:00:20.153120 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant: tempest-AttachVolumeNegativeTest-973579303 Oct 17 04:00:20.153120 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant-Id: 8af3ce80f169473882a247ba78d3d6ef Oct 17 04:00:20.153120 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-973579303 Oct 17 04:00:20.153120 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User: tempest-AttachVolumeNegativeTest-973579303-project Oct 17 04:00:20.153120 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Domain-Id: default Oct 17 04:00:20.153120 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Domain-Name: Default Oct 17 04:00:20.153120 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Id: e9ac14bb6ceb4d9a92a20938e9688bbd Oct 17 04:00:20.153120 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Name: tempest-AttachVolumeNegativeTest-973579303-project Oct 17 04:00:20.153120 dv-cinder-815582-16-smb devstack@n-api.service[125872]: method: > Oct 17 04:00:20.153120 dv-cinder-815582-16-smb devstack@n-api.service[125872]: exception: Instance 6dabcc62-4829-4f97-830f-e82af447faca could not be found. Oct 17 04:00:20.153120 dv-cinder-815582-16-smb devstack@n-api.service[125872]: action_args: {'id': '6dabcc62-4829-4f97-830f-e82af447faca'} Oct 17 04:00:20.153938 dv-cinder-815582-16-smb devstack@n-api.service[125872]: {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:00:20.153938 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:00:20.153938 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 04:00:20.153938 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 04:00:20.153938 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 04:00:20.153938 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 04:00:20.153938 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 04:00:20.153938 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 04:00:20.153938 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 04:00:20.153938 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 04:00:20.153938 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dabcc62-4829-4f97-830f-e82af447faca could not be found. Oct 17 04:00:20.153938 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 04:00:20.153938 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:00:20.153938 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 04:00:20.153938 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:00:20.153938 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:00:20.153938 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:00:20.153938 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:00:20.153938 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:00:20.153938 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:00:20.155145 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:00:20.155145 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 04:00:20.155145 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 04:00:20.155145 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 04:00:20.155145 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 04:00:20.155145 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 04:00:20.155145 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:00:20.155145 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dabcc62-4829-4f97-830f-e82af447faca could not be found. Oct 17 04:00:20.155145 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 04:00:20.155145 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:00:20.155145 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 04:00:20.155145 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:00:20.155145 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:00:20.155145 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:00:20.155145 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:00:20.155145 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:00:20.155145 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dabcc62-4829-4f97-830f-e82af447faca could not be found. Oct 17 04:00:20.155145 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 04:00:20.156411 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-57b476b9-4305-4e70-a36a-fe00ae3d2ace tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Returning 404 to user: Instance 6dabcc62-4829-4f97-830f-e82af447faca could not be found. {{(pid=125872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:00:20.156411 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-57b476b9-4305-4e70-a36a-fe00ae3d2ace tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca" status: 404 len: 111 microversion: 2.1 time: 0.031619 Oct 17 04:00:20.156411 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 467/940] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 04:00:20 2022] GET /compute/v2.1/servers/6dabcc62-4829-4f97-830f-e82af447faca => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 04:00:20.160892 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-8ff47436-4160-402c-bde6-7e40b2859309 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:20.161403 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-8ff47436-4160-402c-bde6-7e40b2859309 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 44d8e487-b994-45ac-b2e4-47a6b7d425fe] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:00:20.167315 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8ff47436-4160-402c-bde6-7e40b2859309 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:20.167803 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8ff47436-4160-402c-bde6-7e40b2859309 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:20.168242 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8ff47436-4160-402c-bde6-7e40b2859309 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:20.168962 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8ff47436-4160-402c-bde6-7e40b2859309 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:20.169448 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8ff47436-4160-402c-bde6-7e40b2859309 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:20.169874 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8ff47436-4160-402c-bde6-7e40b2859309 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:20.183755 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.wsgi [None req-8ff47436-4160-402c-bde6-7e40b2859309 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] HTTP exception thrown: Instance 44d8e487-b994-45ac-b2e4-47a6b7d425fe could not be found. Oct 17 04:00:20.185321 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-8ff47436-4160-402c-bde6-7e40b2859309 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Request method failure captured: Oct 17 04:00:20.185321 dv-cinder-815582-16-smb devstack@n-api.service[125872]: request: DELETE /compute/v2.1/servers/44d8e487-b994-45ac-b2e4-47a6b7d425fe HTTP/1.1 Oct 17 04:00:20.185321 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Accept: application/json Oct 17 04:00:20.185321 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Accept-Encoding: identity Oct 17 04:00:20.185321 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Connection: close Oct 17 04:00:20.185321 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Content-Length: 0 Oct 17 04:00:20.185321 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Content-Type: application/json Oct 17 04:00:20.185321 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Host: 10.222.0.16 Oct 17 04:00:20.185321 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Openstack-System-Scope: None Oct 17 04:00:20.185321 dv-cinder-815582-16-smb devstack@n-api.service[125872]: User-Agent: python-urllib3/1.26.12 Oct 17 04:00:20.185321 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Auth-Token: gAAAAABjTNHS-JkBpYGlE8smCEkK5jojHou0K6VK_tNmdNYF8mJS0isG5A2O-CJO1Z0ixcowhaVCDpWbdKHf1nvQBjXwKqEHeDqSudyXAc3IKeNiaKgebnu28MS5PTi1Pi3TKRwLiMEjkJOln2AC5NFbphJ0QfPkQ085FD6azHU6IqdftqedhcI Oct 17 04:00:20.185321 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Domain-Id: None Oct 17 04:00:20.185321 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Domain-Name: None Oct 17 04:00:20.185321 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Identity-Status: Confirmed Oct 17 04:00:20.185321 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Is-Admin-Project: True Oct 17 04:00:20.185321 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Domain-Id: default Oct 17 04:00:20.185321 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Domain-Name: Default Oct 17 04:00:20.185321 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Id: 8af3ce80f169473882a247ba78d3d6ef Oct 17 04:00:20.185321 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Name: tempest-AttachVolumeNegativeTest-973579303 Oct 17 04:00:20.185321 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Role: reader,member Oct 17 04:00:20.185321 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Roles: reader,member Oct 17 04:00:20.186918 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8af3ce80f169473882a247ba78d3d6ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8af3ce80f169473882a247ba78d3d6ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8af3ce80f169473882a247ba78d3d6ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8af3ce80f169473882a247ba78d3d6ef", "adminURL": "http://10.222.0.16:8080"}]}] Oct 17 04:00:20.186918 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant: tempest-AttachVolumeNegativeTest-973579303 Oct 17 04:00:20.186918 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant-Id: 8af3ce80f169473882a247ba78d3d6ef Oct 17 04:00:20.186918 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-973579303 Oct 17 04:00:20.186918 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User: tempest-AttachVolumeNegativeTest-973579303-project Oct 17 04:00:20.186918 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Domain-Id: default Oct 17 04:00:20.186918 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Domain-Name: Default Oct 17 04:00:20.186918 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Id: e9ac14bb6ceb4d9a92a20938e9688bbd Oct 17 04:00:20.186918 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Name: tempest-AttachVolumeNegativeTest-973579303-project Oct 17 04:00:20.186918 dv-cinder-815582-16-smb devstack@n-api.service[125872]: method: > Oct 17 04:00:20.186918 dv-cinder-815582-16-smb devstack@n-api.service[125872]: exception: Instance 44d8e487-b994-45ac-b2e4-47a6b7d425fe could not be found. Oct 17 04:00:20.186918 dv-cinder-815582-16-smb devstack@n-api.service[125872]: action_args: {'id': '44d8e487-b994-45ac-b2e4-47a6b7d425fe'} Oct 17 04:00:20.187891 dv-cinder-815582-16-smb devstack@n-api.service[125872]: {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:00:20.187891 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:00:20.187891 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 04:00:20.187891 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 04:00:20.187891 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 04:00:20.187891 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 04:00:20.187891 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 04:00:20.187891 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 04:00:20.187891 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 04:00:20.187891 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 04:00:20.187891 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44d8e487-b994-45ac-b2e4-47a6b7d425fe could not be found. Oct 17 04:00:20.187891 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 04:00:20.187891 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:00:20.187891 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 04:00:20.187891 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:00:20.187891 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:00:20.187891 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:00:20.187891 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:00:20.187891 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:00:20.187891 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:00:20.189453 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:00:20.189453 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 04:00:20.189453 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 04:00:20.189453 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 04:00:20.189453 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 04:00:20.189453 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 04:00:20.189453 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 04:00:20.189453 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 04:00:20.189453 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:00:20.189453 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44d8e487-b994-45ac-b2e4-47a6b7d425fe could not be found. Oct 17 04:00:20.189453 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 04:00:20.189453 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:00:20.189453 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 04:00:20.189453 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:00:20.189453 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:00:20.189453 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:00:20.189453 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:00:20.189453 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:00:20.189453 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44d8e487-b994-45ac-b2e4-47a6b7d425fe could not be found. Oct 17 04:00:20.189453 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 04:00:20.192054 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-8ff47436-4160-402c-bde6-7e40b2859309 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Returning 404 to user: Instance 44d8e487-b994-45ac-b2e4-47a6b7d425fe could not be found. {{(pid=125872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:00:20.192054 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-8ff47436-4160-402c-bde6-7e40b2859309 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "DELETE /compute/v2.1/servers/44d8e487-b994-45ac-b2e4-47a6b7d425fe" status: 404 len: 111 microversion: 2.1 time: 0.029716 Oct 17 04:00:20.192054 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 468/941] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 17 04:00:20 2022] DELETE /compute/v2.1/servers/44d8e487-b994-45ac-b2e4-47a6b7d425fe => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 04:00:20.199143 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-981a43a0-6f5b-40bb-9788-ae61ba014480 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:20.199779 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-981a43a0-6f5b-40bb-9788-ae61ba014480 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: 44d8e487-b994-45ac-b2e4-47a6b7d425fe] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:00:20.205729 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-981a43a0-6f5b-40bb-9788-ae61ba014480 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:20.208959 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-981a43a0-6f5b-40bb-9788-ae61ba014480 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:20.208959 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-981a43a0-6f5b-40bb-9788-ae61ba014480 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:20.208959 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-981a43a0-6f5b-40bb-9788-ae61ba014480 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:20.208959 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-981a43a0-6f5b-40bb-9788-ae61ba014480 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:20.209425 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-981a43a0-6f5b-40bb-9788-ae61ba014480 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:20.224126 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.wsgi [None req-981a43a0-6f5b-40bb-9788-ae61ba014480 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] HTTP exception thrown: Instance 44d8e487-b994-45ac-b2e4-47a6b7d425fe could not be found. Oct 17 04:00:20.225653 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-981a43a0-6f5b-40bb-9788-ae61ba014480 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Request method failure captured: Oct 17 04:00:20.225653 dv-cinder-815582-16-smb devstack@n-api.service[125872]: request: GET /compute/v2.1/servers/44d8e487-b994-45ac-b2e4-47a6b7d425fe HTTP/1.1 Oct 17 04:00:20.225653 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Accept: application/json Oct 17 04:00:20.225653 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Accept-Encoding: identity Oct 17 04:00:20.225653 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Connection: close Oct 17 04:00:20.225653 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Content-Length: 0 Oct 17 04:00:20.225653 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Content-Type: application/json Oct 17 04:00:20.225653 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Host: 10.222.0.16 Oct 17 04:00:20.225653 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Openstack-System-Scope: None Oct 17 04:00:20.225653 dv-cinder-815582-16-smb devstack@n-api.service[125872]: User-Agent: python-urllib3/1.26.12 Oct 17 04:00:20.225653 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Auth-Token: gAAAAABjTNHS-JkBpYGlE8smCEkK5jojHou0K6VK_tNmdNYF8mJS0isG5A2O-CJO1Z0ixcowhaVCDpWbdKHf1nvQBjXwKqEHeDqSudyXAc3IKeNiaKgebnu28MS5PTi1Pi3TKRwLiMEjkJOln2AC5NFbphJ0QfPkQ085FD6azHU6IqdftqedhcI Oct 17 04:00:20.225653 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Domain-Id: None Oct 17 04:00:20.225653 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Domain-Name: None Oct 17 04:00:20.225653 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Identity-Status: Confirmed Oct 17 04:00:20.225653 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Is-Admin-Project: True Oct 17 04:00:20.225653 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Domain-Id: default Oct 17 04:00:20.225653 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Domain-Name: Default Oct 17 04:00:20.225653 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Id: 8af3ce80f169473882a247ba78d3d6ef Oct 17 04:00:20.225653 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Name: tempest-AttachVolumeNegativeTest-973579303 Oct 17 04:00:20.225653 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Role: reader,member Oct 17 04:00:20.225653 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Roles: reader,member Oct 17 04:00:20.227415 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8af3ce80f169473882a247ba78d3d6ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8af3ce80f169473882a247ba78d3d6ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8af3ce80f169473882a247ba78d3d6ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8af3ce80f169473882a247ba78d3d6ef", "adminURL": "http://10.222.0.16:8080"}]}] Oct 17 04:00:20.227415 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant: tempest-AttachVolumeNegativeTest-973579303 Oct 17 04:00:20.227415 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant-Id: 8af3ce80f169473882a247ba78d3d6ef Oct 17 04:00:20.227415 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-973579303 Oct 17 04:00:20.227415 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User: tempest-AttachVolumeNegativeTest-973579303-project Oct 17 04:00:20.227415 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Domain-Id: default Oct 17 04:00:20.227415 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Domain-Name: Default Oct 17 04:00:20.227415 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Id: e9ac14bb6ceb4d9a92a20938e9688bbd Oct 17 04:00:20.227415 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Name: tempest-AttachVolumeNegativeTest-973579303-project Oct 17 04:00:20.227415 dv-cinder-815582-16-smb devstack@n-api.service[125872]: method: > Oct 17 04:00:20.227415 dv-cinder-815582-16-smb devstack@n-api.service[125872]: exception: Instance 44d8e487-b994-45ac-b2e4-47a6b7d425fe could not be found. Oct 17 04:00:20.227415 dv-cinder-815582-16-smb devstack@n-api.service[125872]: action_args: {'id': '44d8e487-b994-45ac-b2e4-47a6b7d425fe'} Oct 17 04:00:20.232262 dv-cinder-815582-16-smb devstack@n-api.service[125872]: {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:00:20.232262 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:00:20.232262 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 04:00:20.232262 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 04:00:20.232262 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 04:00:20.232262 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 04:00:20.232262 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 04:00:20.232262 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 04:00:20.232262 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 04:00:20.232262 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 04:00:20.232262 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44d8e487-b994-45ac-b2e4-47a6b7d425fe could not be found. Oct 17 04:00:20.232262 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 04:00:20.232262 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:00:20.232262 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 04:00:20.232262 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:00:20.232262 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:00:20.232262 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:00:20.232262 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:00:20.232262 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:00:20.232262 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:00:20.233476 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:00:20.233476 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 04:00:20.233476 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 04:00:20.233476 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 04:00:20.233476 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 04:00:20.233476 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 04:00:20.233476 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:00:20.233476 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44d8e487-b994-45ac-b2e4-47a6b7d425fe could not be found. Oct 17 04:00:20.233476 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 04:00:20.233476 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:00:20.233476 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 04:00:20.233476 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:00:20.233476 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:00:20.233476 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:00:20.233476 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:00:20.233476 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:00:20.233476 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44d8e487-b994-45ac-b2e4-47a6b7d425fe could not be found. Oct 17 04:00:20.233476 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 04:00:20.234648 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-981a43a0-6f5b-40bb-9788-ae61ba014480 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Returning 404 to user: Instance 44d8e487-b994-45ac-b2e4-47a6b7d425fe could not be found. {{(pid=125872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:00:20.234648 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-981a43a0-6f5b-40bb-9788-ae61ba014480 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/44d8e487-b994-45ac-b2e4-47a6b7d425fe" status: 404 len: 111 microversion: 2.1 time: 0.031731 Oct 17 04:00:20.234648 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 469/942] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 04:00:20 2022] GET /compute/v2.1/servers/44d8e487-b994-45ac-b2e4-47a6b7d425fe => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 04:00:20.303835 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-b355db21-f472-4ebe-83ac-4c4d797e6b64 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6/os-volume_attachments/372b0566-b7fb-46fe-b038-a9ddf1730978" status: 202 len: 0 microversion: 2.20 time: 0.629997 Oct 17 04:00:20.304451 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 474/943] 10.222.0.16 () {60 vars in 1457 bytes} [Mon Oct 17 04:00:19 2022] DELETE /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6/os-volume_attachments/372b0566-b7fb-46fe-b038-a9ddf1730978 => generated 0 bytes in 631 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 04:00:20.371620 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-30185bc1-cf95-45ce-8a11-79b3dab4f510 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:00:20.372245 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-30185bc1-cf95-45ce-8a11-79b3dab4f510 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:00:20.378800 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-30185bc1-cf95-45ce-8a11-79b3dab4f510 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:20.381745 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-30185bc1-cf95-45ce-8a11-79b3dab4f510 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:20.381745 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-30185bc1-cf95-45ce-8a11-79b3dab4f510 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:20.381745 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-30185bc1-cf95-45ce-8a11-79b3dab4f510 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:20.381745 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-30185bc1-cf95-45ce-8a11-79b3dab4f510 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:20.382099 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-30185bc1-cf95-45ce-8a11-79b3dab4f510 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:20.483804 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-30185bc1-cf95-45ce-8a11-79b3dab4f510 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=125872) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 17 04:00:20.752844 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-30185bc1-cf95-45ce-8a11-79b3dab4f510 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "POST /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6/action" status: 202 len: 0 microversion: 2.20 time: 0.385146 Oct 17 04:00:20.753664 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 470/944] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Oct 17 04:00:20 2022] POST /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6/action => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 04:00:20.763418 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-0f670ff0-cbf2-4f34-9da5-90a7293a3c2c tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:20.764031 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-0f670ff0-cbf2-4f34-9da5-90a7293a3c2c tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:00:20.770961 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0f670ff0-cbf2-4f34-9da5-90a7293a3c2c tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:20.771596 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0f670ff0-cbf2-4f34-9da5-90a7293a3c2c tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:20.772030 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0f670ff0-cbf2-4f34-9da5-90a7293a3c2c tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:20.773009 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0f670ff0-cbf2-4f34-9da5-90a7293a3c2c tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:20.773820 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0f670ff0-cbf2-4f34-9da5-90a7293a3c2c tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:20.774246 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0f670ff0-cbf2-4f34-9da5-90a7293a3c2c tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:20.912359 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-0f670ff0-cbf2-4f34-9da5-90a7293a3c2c tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:20.921016 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-0f670ff0-cbf2-4f34-9da5-90a7293a3c2c tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:20.923351 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-0f670ff0-cbf2-4f34-9da5-90a7293a3c2c tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:20.924861 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-0f670ff0-cbf2-4f34-9da5-90a7293a3c2c tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6" status: 200 len: 1671 microversion: 2.20 time: 0.165606 Oct 17 04:00:20.926157 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 475/945] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 04:00:20 2022] GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6 => generated 1671 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 04:00:21.536413 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-12e695e0-9e61-4b44-9364-67a715a63db5 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:21.536919 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-12e695e0-9e61-4b44-9364-67a715a63db5 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: ff49fd54-9ddf-415d-8eb4-fb1b0bef634c] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:00:21.543457 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-12e695e0-9e61-4b44-9364-67a715a63db5 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:21.543949 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-12e695e0-9e61-4b44-9364-67a715a63db5 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:21.544394 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-12e695e0-9e61-4b44-9364-67a715a63db5 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:21.545096 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-12e695e0-9e61-4b44-9364-67a715a63db5 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:21.545550 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-12e695e0-9e61-4b44-9364-67a715a63db5 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:21.546183 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-12e695e0-9e61-4b44-9364-67a715a63db5 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:21.560248 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.wsgi [None req-12e695e0-9e61-4b44-9364-67a715a63db5 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] HTTP exception thrown: Instance ff49fd54-9ddf-415d-8eb4-fb1b0bef634c could not be found. Oct 17 04:00:21.562058 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-12e695e0-9e61-4b44-9364-67a715a63db5 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Request method failure captured: Oct 17 04:00:21.562058 dv-cinder-815582-16-smb devstack@n-api.service[125872]: request: DELETE /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c HTTP/1.1 Oct 17 04:00:21.562058 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Accept: application/json Oct 17 04:00:21.562058 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Accept-Encoding: identity Oct 17 04:00:21.562058 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Connection: close Oct 17 04:00:21.562058 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Content-Length: 0 Oct 17 04:00:21.562058 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Content-Type: application/json Oct 17 04:00:21.562058 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Host: 10.222.0.16 Oct 17 04:00:21.562058 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Openstack-System-Scope: None Oct 17 04:00:21.562058 dv-cinder-815582-16-smb devstack@n-api.service[125872]: User-Agent: python-urllib3/1.26.12 Oct 17 04:00:21.562058 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Auth-Token: gAAAAABjTNHS-JkBpYGlE8smCEkK5jojHou0K6VK_tNmdNYF8mJS0isG5A2O-CJO1Z0ixcowhaVCDpWbdKHf1nvQBjXwKqEHeDqSudyXAc3IKeNiaKgebnu28MS5PTi1Pi3TKRwLiMEjkJOln2AC5NFbphJ0QfPkQ085FD6azHU6IqdftqedhcI Oct 17 04:00:21.562058 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Domain-Id: None Oct 17 04:00:21.562058 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Domain-Name: None Oct 17 04:00:21.562058 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Identity-Status: Confirmed Oct 17 04:00:21.562058 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Is-Admin-Project: True Oct 17 04:00:21.562058 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Domain-Id: default Oct 17 04:00:21.562058 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Domain-Name: Default Oct 17 04:00:21.562058 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Id: 8af3ce80f169473882a247ba78d3d6ef Oct 17 04:00:21.562058 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Name: tempest-AttachVolumeNegativeTest-973579303 Oct 17 04:00:21.562058 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Role: reader,member Oct 17 04:00:21.562058 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Roles: reader,member Oct 17 04:00:21.563937 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8af3ce80f169473882a247ba78d3d6ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8af3ce80f169473882a247ba78d3d6ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8af3ce80f169473882a247ba78d3d6ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8af3ce80f169473882a247ba78d3d6ef", "adminURL": "http://10.222.0.16:8080"}]}] Oct 17 04:00:21.563937 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant: tempest-AttachVolumeNegativeTest-973579303 Oct 17 04:00:21.563937 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant-Id: 8af3ce80f169473882a247ba78d3d6ef Oct 17 04:00:21.563937 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-973579303 Oct 17 04:00:21.563937 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User: tempest-AttachVolumeNegativeTest-973579303-project Oct 17 04:00:21.563937 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Domain-Id: default Oct 17 04:00:21.563937 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Domain-Name: Default Oct 17 04:00:21.563937 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Id: e9ac14bb6ceb4d9a92a20938e9688bbd Oct 17 04:00:21.563937 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Name: tempest-AttachVolumeNegativeTest-973579303-project Oct 17 04:00:21.563937 dv-cinder-815582-16-smb devstack@n-api.service[125872]: method: > Oct 17 04:00:21.563937 dv-cinder-815582-16-smb devstack@n-api.service[125872]: exception: Instance ff49fd54-9ddf-415d-8eb4-fb1b0bef634c could not be found. Oct 17 04:00:21.563937 dv-cinder-815582-16-smb devstack@n-api.service[125872]: action_args: {'id': 'ff49fd54-9ddf-415d-8eb4-fb1b0bef634c'} Oct 17 04:00:21.564973 dv-cinder-815582-16-smb devstack@n-api.service[125872]: {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:00:21.564973 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:00:21.564973 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 04:00:21.564973 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 04:00:21.564973 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 04:00:21.564973 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 04:00:21.564973 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 04:00:21.564973 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 04:00:21.564973 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 04:00:21.564973 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 04:00:21.564973 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff49fd54-9ddf-415d-8eb4-fb1b0bef634c could not be found. Oct 17 04:00:21.564973 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 04:00:21.564973 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:00:21.564973 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 04:00:21.564973 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:00:21.564973 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:00:21.564973 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:00:21.564973 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:00:21.564973 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:00:21.564973 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:00:21.566494 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:00:21.566494 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 04:00:21.566494 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 04:00:21.566494 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 04:00:21.566494 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 04:00:21.566494 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 04:00:21.566494 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 04:00:21.566494 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 04:00:21.566494 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:00:21.566494 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff49fd54-9ddf-415d-8eb4-fb1b0bef634c could not be found. Oct 17 04:00:21.566494 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 04:00:21.566494 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:00:21.566494 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 04:00:21.566494 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:00:21.566494 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:00:21.566494 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:00:21.566494 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:00:21.566494 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:00:21.566494 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff49fd54-9ddf-415d-8eb4-fb1b0bef634c could not be found. Oct 17 04:00:21.566494 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 04:00:21.568519 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-12e695e0-9e61-4b44-9364-67a715a63db5 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Returning 404 to user: Instance ff49fd54-9ddf-415d-8eb4-fb1b0bef634c could not be found. {{(pid=125872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:00:21.568519 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-12e695e0-9e61-4b44-9364-67a715a63db5 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c" status: 404 len: 111 microversion: 2.1 time: 0.031617 Oct 17 04:00:21.568519 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 471/946] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 17 04:00:21 2022] DELETE /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 04:00:21.576381 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-d02d1807-38c4-4410-bd56-89a3226f2fc6 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:21.577040 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-d02d1807-38c4-4410-bd56-89a3226f2fc6 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] [instance: ff49fd54-9ddf-415d-8eb4-fb1b0bef634c] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:00:21.585119 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d02d1807-38c4-4410-bd56-89a3226f2fc6 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:21.585738 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d02d1807-38c4-4410-bd56-89a3226f2fc6 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:21.586175 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d02d1807-38c4-4410-bd56-89a3226f2fc6 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:21.587070 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d02d1807-38c4-4410-bd56-89a3226f2fc6 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:21.587641 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d02d1807-38c4-4410-bd56-89a3226f2fc6 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:21.588101 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d02d1807-38c4-4410-bd56-89a3226f2fc6 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:21.605490 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.wsgi [None req-d02d1807-38c4-4410-bd56-89a3226f2fc6 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] HTTP exception thrown: Instance ff49fd54-9ddf-415d-8eb4-fb1b0bef634c could not be found. Oct 17 04:00:21.607035 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-d02d1807-38c4-4410-bd56-89a3226f2fc6 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Request method failure captured: Oct 17 04:00:21.607035 dv-cinder-815582-16-smb devstack@n-api.service[125871]: request: GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c HTTP/1.1 Oct 17 04:00:21.607035 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Accept: application/json Oct 17 04:00:21.607035 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Accept-Encoding: identity Oct 17 04:00:21.607035 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Connection: close Oct 17 04:00:21.607035 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Content-Length: 0 Oct 17 04:00:21.607035 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Content-Type: application/json Oct 17 04:00:21.607035 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Host: 10.222.0.16 Oct 17 04:00:21.607035 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Openstack-System-Scope: None Oct 17 04:00:21.607035 dv-cinder-815582-16-smb devstack@n-api.service[125871]: User-Agent: python-urllib3/1.26.12 Oct 17 04:00:21.607035 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Auth-Token: gAAAAABjTNHS-JkBpYGlE8smCEkK5jojHou0K6VK_tNmdNYF8mJS0isG5A2O-CJO1Z0ixcowhaVCDpWbdKHf1nvQBjXwKqEHeDqSudyXAc3IKeNiaKgebnu28MS5PTi1Pi3TKRwLiMEjkJOln2AC5NFbphJ0QfPkQ085FD6azHU6IqdftqedhcI Oct 17 04:00:21.607035 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Domain-Id: None Oct 17 04:00:21.607035 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Domain-Name: None Oct 17 04:00:21.607035 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Identity-Status: Confirmed Oct 17 04:00:21.607035 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Is-Admin-Project: True Oct 17 04:00:21.607035 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Domain-Id: default Oct 17 04:00:21.607035 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Domain-Name: Default Oct 17 04:00:21.607035 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Id: 8af3ce80f169473882a247ba78d3d6ef Oct 17 04:00:21.607035 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Name: tempest-AttachVolumeNegativeTest-973579303 Oct 17 04:00:21.607035 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Role: reader,member Oct 17 04:00:21.607035 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Roles: reader,member Oct 17 04:00:21.608460 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8af3ce80f169473882a247ba78d3d6ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8af3ce80f169473882a247ba78d3d6ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8af3ce80f169473882a247ba78d3d6ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8af3ce80f169473882a247ba78d3d6ef", "adminURL": "http://10.222.0.16:8080"}]}] Oct 17 04:00:21.608460 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant: tempest-AttachVolumeNegativeTest-973579303 Oct 17 04:00:21.608460 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant-Id: 8af3ce80f169473882a247ba78d3d6ef Oct 17 04:00:21.608460 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-973579303 Oct 17 04:00:21.608460 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User: tempest-AttachVolumeNegativeTest-973579303-project Oct 17 04:00:21.608460 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Domain-Id: default Oct 17 04:00:21.608460 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Domain-Name: Default Oct 17 04:00:21.608460 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Id: e9ac14bb6ceb4d9a92a20938e9688bbd Oct 17 04:00:21.608460 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Name: tempest-AttachVolumeNegativeTest-973579303-project Oct 17 04:00:21.608460 dv-cinder-815582-16-smb devstack@n-api.service[125871]: method: > Oct 17 04:00:21.608460 dv-cinder-815582-16-smb devstack@n-api.service[125871]: exception: Instance ff49fd54-9ddf-415d-8eb4-fb1b0bef634c could not be found. Oct 17 04:00:21.608460 dv-cinder-815582-16-smb devstack@n-api.service[125871]: action_args: {'id': 'ff49fd54-9ddf-415d-8eb4-fb1b0bef634c'} Oct 17 04:00:21.609340 dv-cinder-815582-16-smb devstack@n-api.service[125871]: {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:00:21.609340 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:00:21.609340 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 04:00:21.609340 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 04:00:21.609340 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 04:00:21.609340 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 04:00:21.609340 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 04:00:21.609340 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 04:00:21.609340 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 04:00:21.609340 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 04:00:21.609340 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff49fd54-9ddf-415d-8eb4-fb1b0bef634c could not be found. Oct 17 04:00:21.609340 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 04:00:21.609340 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:00:21.609340 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 04:00:21.609340 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:00:21.609340 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:00:21.609340 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:00:21.609340 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:00:21.609340 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:00:21.609340 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:00:21.610918 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:00:21.610918 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 04:00:21.610918 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 04:00:21.610918 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 04:00:21.610918 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 04:00:21.610918 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 04:00:21.610918 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:00:21.610918 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff49fd54-9ddf-415d-8eb4-fb1b0bef634c could not be found. Oct 17 04:00:21.610918 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 04:00:21.610918 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:00:21.610918 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 04:00:21.610918 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:00:21.610918 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:00:21.610918 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:00:21.610918 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:00:21.610918 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:00:21.610918 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff49fd54-9ddf-415d-8eb4-fb1b0bef634c could not be found. Oct 17 04:00:21.610918 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 04:00:21.612404 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-d02d1807-38c4-4410-bd56-89a3226f2fc6 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] Returning 404 to user: Instance ff49fd54-9ddf-415d-8eb4-fb1b0bef634c could not be found. {{(pid=125871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:00:21.612404 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-d02d1807-38c4-4410-bd56-89a3226f2fc6 tempest-AttachVolumeNegativeTest-973579303 tempest-AttachVolumeNegativeTest-973579303-project] 10.222.0.16 "GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c" status: 404 len: 111 microversion: 2.1 time: 0.038059 Oct 17 04:00:21.612404 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 476/947] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 04:00:21 2022] GET /compute/v2.1/servers/ff49fd54-9ddf-415d-8eb4-fb1b0bef634c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 04:00:21.950625 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-0cb62401-8977-4628-9be7-40e4dbbda626 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:21.951396 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-0cb62401-8977-4628-9be7-40e4dbbda626 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:00:21.957517 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0cb62401-8977-4628-9be7-40e4dbbda626 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:21.958079 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0cb62401-8977-4628-9be7-40e4dbbda626 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:21.958588 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0cb62401-8977-4628-9be7-40e4dbbda626 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:21.959392 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0cb62401-8977-4628-9be7-40e4dbbda626 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:21.959842 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0cb62401-8977-4628-9be7-40e4dbbda626 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:21.963394 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0cb62401-8977-4628-9be7-40e4dbbda626 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:22.110739 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-0cb62401-8977-4628-9be7-40e4dbbda626 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:22.119916 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-0cb62401-8977-4628-9be7-40e4dbbda626 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:22.121698 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-0cb62401-8977-4628-9be7-40e4dbbda626 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:22.123022 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-0cb62401-8977-4628-9be7-40e4dbbda626 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6" status: 200 len: 1671 microversion: 2.20 time: 0.176298 Oct 17 04:00:22.123806 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 472/948] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 04:00:21 2022] GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6 => generated 1671 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:00:23.149268 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-206e9c43-9ca1-4fd9-89f8-a97fe8e3bba4 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:23.149887 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-206e9c43-9ca1-4fd9-89f8-a97fe8e3bba4 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:00:23.156578 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-206e9c43-9ca1-4fd9-89f8-a97fe8e3bba4 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:23.157067 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-206e9c43-9ca1-4fd9-89f8-a97fe8e3bba4 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:23.157504 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-206e9c43-9ca1-4fd9-89f8-a97fe8e3bba4 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:23.158208 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-206e9c43-9ca1-4fd9-89f8-a97fe8e3bba4 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:23.158854 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-206e9c43-9ca1-4fd9-89f8-a97fe8e3bba4 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:23.159843 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-206e9c43-9ca1-4fd9-89f8-a97fe8e3bba4 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:23.436192 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-206e9c43-9ca1-4fd9-89f8-a97fe8e3bba4 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:23.440817 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-206e9c43-9ca1-4fd9-89f8-a97fe8e3bba4 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:23.445060 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-206e9c43-9ca1-4fd9-89f8-a97fe8e3bba4 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:23.448252 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-206e9c43-9ca1-4fd9-89f8-a97fe8e3bba4 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6" status: 200 len: 1729 microversion: 2.20 time: 0.302952 Oct 17 04:00:23.448835 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 477/949] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 04:00:23 2022] GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6 => generated 1729 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:00:24.478447 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-b43e0a01-e8d2-4da0-b65d-728540cabfb8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:24.479119 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-b43e0a01-e8d2-4da0-b65d-728540cabfb8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:00:24.497706 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b43e0a01-e8d2-4da0-b65d-728540cabfb8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:24.499388 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b43e0a01-e8d2-4da0-b65d-728540cabfb8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:24.500071 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b43e0a01-e8d2-4da0-b65d-728540cabfb8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:24.501209 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b43e0a01-e8d2-4da0-b65d-728540cabfb8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:24.501859 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b43e0a01-e8d2-4da0-b65d-728540cabfb8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:24.502495 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b43e0a01-e8d2-4da0-b65d-728540cabfb8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:24.665225 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-b43e0a01-e8d2-4da0-b65d-728540cabfb8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:24.675295 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-b43e0a01-e8d2-4da0-b65d-728540cabfb8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:24.677002 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-b43e0a01-e8d2-4da0-b65d-728540cabfb8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:24.678347 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-b43e0a01-e8d2-4da0-b65d-728540cabfb8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6" status: 200 len: 1729 microversion: 2.20 time: 0.207741 Oct 17 04:00:24.679568 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 473/950] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 04:00:24 2022] GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6 => generated 1729 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:00:25.706235 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-9cae9191-ffef-46dd-bba5-9c3c3dffa371 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:25.706235 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-9cae9191-ffef-46dd-bba5-9c3c3dffa371 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:00:25.714542 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-9cae9191-ffef-46dd-bba5-9c3c3dffa371 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:25.715043 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-9cae9191-ffef-46dd-bba5-9c3c3dffa371 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:25.715510 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-9cae9191-ffef-46dd-bba5-9c3c3dffa371 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:25.718498 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-9cae9191-ffef-46dd-bba5-9c3c3dffa371 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:25.720347 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-9cae9191-ffef-46dd-bba5-9c3c3dffa371 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:25.721065 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-9cae9191-ffef-46dd-bba5-9c3c3dffa371 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:26.068409 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-9cae9191-ffef-46dd-bba5-9c3c3dffa371 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:26.080567 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-9cae9191-ffef-46dd-bba5-9c3c3dffa371 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:26.085302 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-9cae9191-ffef-46dd-bba5-9c3c3dffa371 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:26.086504 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-9cae9191-ffef-46dd-bba5-9c3c3dffa371 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6" status: 200 len: 1729 microversion: 2.20 time: 0.386277 Oct 17 04:00:26.089246 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 478/951] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 04:00:25 2022] GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6 => generated 1729 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:00:27.114642 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-58f191a3-5d2d-4666-a52b-843491d88cd8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:27.115284 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-58f191a3-5d2d-4666-a52b-843491d88cd8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:00:27.124378 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-58f191a3-5d2d-4666-a52b-843491d88cd8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:27.125112 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-58f191a3-5d2d-4666-a52b-843491d88cd8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:27.125951 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-58f191a3-5d2d-4666-a52b-843491d88cd8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:27.127591 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-58f191a3-5d2d-4666-a52b-843491d88cd8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:27.128319 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-58f191a3-5d2d-4666-a52b-843491d88cd8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:27.128949 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-58f191a3-5d2d-4666-a52b-843491d88cd8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:27.162905 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:00:27.324043 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-58f191a3-5d2d-4666-a52b-843491d88cd8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:27.340560 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-58f191a3-5d2d-4666-a52b-843491d88cd8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:27.342951 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-58f191a3-5d2d-4666-a52b-843491d88cd8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:27.344457 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-58f191a3-5d2d-4666-a52b-843491d88cd8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6" status: 200 len: 1729 microversion: 2.20 time: 0.234535 Oct 17 04:00:27.345206 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 474/952] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 04:00:27 2022] GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6 => generated 1729 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 04:00:28.375601 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-f49d24ff-6ff6-440a-89b7-09a2222e076f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:28.376206 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-f49d24ff-6ff6-440a-89b7-09a2222e076f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:00:28.383266 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f49d24ff-6ff6-440a-89b7-09a2222e076f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:28.384056 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f49d24ff-6ff6-440a-89b7-09a2222e076f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:28.384492 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f49d24ff-6ff6-440a-89b7-09a2222e076f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:28.385208 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f49d24ff-6ff6-440a-89b7-09a2222e076f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:28.385662 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f49d24ff-6ff6-440a-89b7-09a2222e076f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:28.386078 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f49d24ff-6ff6-440a-89b7-09a2222e076f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:28.545958 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-f49d24ff-6ff6-440a-89b7-09a2222e076f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:28.560201 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-f49d24ff-6ff6-440a-89b7-09a2222e076f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:28.564109 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-f49d24ff-6ff6-440a-89b7-09a2222e076f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:28.564109 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-f49d24ff-6ff6-440a-89b7-09a2222e076f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6" status: 200 len: 1729 microversion: 2.20 time: 0.191355 Oct 17 04:00:28.564109 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 479/953] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 04:00:28 2022] GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6 => generated 1729 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:00:29.135354 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-8b36d500-d42f-4ab7-b051-7b001d49817a tempest-VolumesSnapshotsTestJSON-1497653836 tempest-VolumesSnapshotsTestJSON-1497653836-project] Action: 'create', calling method: .version_select at 0x7fd72a702820>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-81538309"}} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:00:29.593726 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-f45ee6e9-3cab-4f4e-a2d6-a07394e22ebf tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:29.594270 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-f45ee6e9-3cab-4f4e-a2d6-a07394e22ebf tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:00:29.608541 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f45ee6e9-3cab-4f4e-a2d6-a07394e22ebf tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:29.608541 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f45ee6e9-3cab-4f4e-a2d6-a07394e22ebf tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:29.608541 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f45ee6e9-3cab-4f4e-a2d6-a07394e22ebf tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:29.608541 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f45ee6e9-3cab-4f4e-a2d6-a07394e22ebf tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:29.608878 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f45ee6e9-3cab-4f4e-a2d6-a07394e22ebf tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:29.608878 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-f45ee6e9-3cab-4f4e-a2d6-a07394e22ebf tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:29.767341 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-f45ee6e9-3cab-4f4e-a2d6-a07394e22ebf tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:29.778805 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-f45ee6e9-3cab-4f4e-a2d6-a07394e22ebf tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:29.780725 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-f45ee6e9-3cab-4f4e-a2d6-a07394e22ebf tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:29.782130 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-f45ee6e9-3cab-4f4e-a2d6-a07394e22ebf tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6" status: 200 len: 1729 microversion: 2.20 time: 0.192724 Oct 17 04:00:29.782975 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 480/954] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 04:00:29 2022] GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6 => generated 1729 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 04:00:29.899696 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-8b36d500-d42f-4ab7-b051-7b001d49817a tempest-VolumesSnapshotsTestJSON-1497653836 tempest-VolumesSnapshotsTestJSON-1497653836-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 343 microversion: 2.1 time: 0.950667 Oct 17 04:00:29.900632 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 475/955] 10.222.0.16 () {60 vars in 1155 bytes} [Mon Oct 17 04:00:28 2022] POST /compute/v2.1/os-volumes => generated 343 bytes in 953 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 17 04:00:29.915160 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-e8a03477-eeec-4b4d-a784-357d7c5c504c tempest-VolumesSnapshotsTestJSON-1497653836 tempest-VolumesSnapshotsTestJSON-1497653836-project] Calling method '.version_select at 0x7fd72a6a5430>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:29.988805 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-e8a03477-eeec-4b4d-a784-357d7c5c504c tempest-VolumesSnapshotsTestJSON-1497653836 tempest-VolumesSnapshotsTestJSON-1497653836-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/70a63e7f-24f9-4c82-ae1f-0b974d63bbca" status: 200 len: 343 microversion: 2.1 time: 0.077361 Oct 17 04:00:29.989640 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 481/956] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Oct 17 04:00:29 2022] GET /compute/v2.1/os-volumes/70a63e7f-24f9-4c82-ae1f-0b974d63bbca => generated 343 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:00:30.813759 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-26312510-6f05-4b31-9941-3185dbe3847b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:30.814482 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-26312510-6f05-4b31-9941-3185dbe3847b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:00:30.822033 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-26312510-6f05-4b31-9941-3185dbe3847b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:30.822620 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-26312510-6f05-4b31-9941-3185dbe3847b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:30.823127 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-26312510-6f05-4b31-9941-3185dbe3847b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:30.824322 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-26312510-6f05-4b31-9941-3185dbe3847b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:30.825105 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-26312510-6f05-4b31-9941-3185dbe3847b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:30.825735 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-26312510-6f05-4b31-9941-3185dbe3847b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:30.967332 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-26312510-6f05-4b31-9941-3185dbe3847b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:30.975547 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-26312510-6f05-4b31-9941-3185dbe3847b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:30.977208 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-26312510-6f05-4b31-9941-3185dbe3847b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:30.978702 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-26312510-6f05-4b31-9941-3185dbe3847b tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6" status: 200 len: 1729 microversion: 2.20 time: 0.169423 Oct 17 04:00:30.979417 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 476/957] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 04:00:30 2022] GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6 => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:00:31.008357 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-81f58175-8246-457b-a4d0-0084897d3819 tempest-VolumesSnapshotsTestJSON-1497653836 tempest-VolumesSnapshotsTestJSON-1497653836-project] Calling method '.version_select at 0x7fd72a5c64c0>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:31.091296 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-81f58175-8246-457b-a4d0-0084897d3819 tempest-VolumesSnapshotsTestJSON-1497653836 tempest-VolumesSnapshotsTestJSON-1497653836-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/70a63e7f-24f9-4c82-ae1f-0b974d63bbca" status: 200 len: 344 microversion: 2.1 time: 0.090910 Oct 17 04:00:31.092153 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 482/958] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Oct 17 04:00:30 2022] GET /compute/v2.1/os-volumes/70a63e7f-24f9-4c82-ae1f-0b974d63bbca => generated 344 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:00:31.111422 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-946cf2a6-850b-4ae7-a277-31356a6af0d3 tempest-VolumesSnapshotsTestJSON-1497653836 tempest-VolumesSnapshotsTestJSON-1497653836-project] Action: 'create', calling method: .version_select at 0x7fd72a7faee0>, body: {"snapshot": {"volume_id": "70a63e7f-24f9-4c82-ae1f-0b974d63bbca", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-318020204"}} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:00:31.505099 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-946cf2a6-850b-4ae7-a277-31356a6af0d3 tempest-VolumesSnapshotsTestJSON-1497653836 tempest-VolumesSnapshotsTestJSON-1497653836-project] 10.222.0.16 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.400696 Oct 17 04:00:31.542236 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 477/959] 10.222.0.16 () {60 vars in 1162 bytes} [Mon Oct 17 04:00:31 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:00:31.543106 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-db1d3b1b-23bc-46ed-b619-0091e55d71e2 tempest-VolumesSnapshotsTestJSON-1497653836 tempest-VolumesSnapshotsTestJSON-1497653836-project] Calling method '.version_select at 0x7fd72a526160>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:31.556244 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-db1d3b1b-23bc-46ed-b619-0091e55d71e2 tempest-VolumesSnapshotsTestJSON-1497653836 tempest-VolumesSnapshotsTestJSON-1497653836-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/fa1faaec-0158-4d02-bce3-446b3a371073" status: 200 len: 286 microversion: 2.1 time: 0.042936 Oct 17 04:00:31.557360 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 483/960] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Oct 17 04:00:31 2022] GET /compute/v2.1/os-snapshots/fa1faaec-0158-4d02-bce3-446b3a371073 => generated 286 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:00:31.569035 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-f8f6509d-4871-449d-ac9d-92afcf6fd106 tempest-VolumesSnapshotsTestJSON-1497653836 tempest-VolumesSnapshotsTestJSON-1497653836-project] Calling method '.version_select at 0x7fd72a6ebdc0>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:31.604404 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-f8f6509d-4871-449d-ac9d-92afcf6fd106 tempest-VolumesSnapshotsTestJSON-1497653836 tempest-VolumesSnapshotsTestJSON-1497653836-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.038818 Oct 17 04:00:31.604404 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 478/961] 10.222.0.16 () {58 vars in 1140 bytes} [Mon Oct 17 04:00:31 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:00:31.616962 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-40a3d1e6-1d87-4c47-a54a-915d7efbcd0b tempest-VolumesSnapshotsTestJSON-1497653836 tempest-VolumesSnapshotsTestJSON-1497653836-project] Calling method '.version_select at 0x7fd72a5770d0>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:31.667093 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-40a3d1e6-1d87-4c47-a54a-915d7efbcd0b tempest-VolumesSnapshotsTestJSON-1497653836 tempest-VolumesSnapshotsTestJSON-1497653836-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/fa1faaec-0158-4d02-bce3-446b3a371073" status: 200 len: 286 microversion: 2.1 time: 0.055091 Oct 17 04:00:31.668335 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 484/962] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Oct 17 04:00:31 2022] GET /compute/v2.1/os-snapshots/fa1faaec-0158-4d02-bce3-446b3a371073 => generated 286 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:00:32.010150 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-fa12a049-58f6-49f3-ac07-2cd62121c173 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:32.010807 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-fa12a049-58f6-49f3-ac07-2cd62121c173 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:00:32.017347 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-fa12a049-58f6-49f3-ac07-2cd62121c173 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:32.017852 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-fa12a049-58f6-49f3-ac07-2cd62121c173 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:32.018288 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-fa12a049-58f6-49f3-ac07-2cd62121c173 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:32.019556 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-fa12a049-58f6-49f3-ac07-2cd62121c173 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:32.020008 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-fa12a049-58f6-49f3-ac07-2cd62121c173 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:32.020432 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-fa12a049-58f6-49f3-ac07-2cd62121c173 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:32.168172 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-fa12a049-58f6-49f3-ac07-2cd62121c173 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:32.195957 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-fa12a049-58f6-49f3-ac07-2cd62121c173 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:32.208148 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-fa12a049-58f6-49f3-ac07-2cd62121c173 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:32.209397 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-fa12a049-58f6-49f3-ac07-2cd62121c173 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6" status: 200 len: 1729 microversion: 2.20 time: 0.206568 Oct 17 04:00:32.212821 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 479/963] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 04:00:32 2022] GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6 => generated 1729 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:00:32.680339 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-bdce6a2c-7575-45ab-bb74-4b05fb76c9f1 tempest-VolumesSnapshotsTestJSON-1497653836 tempest-VolumesSnapshotsTestJSON-1497653836-project] Calling method '.version_select at 0x7fd72a6a4430>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:32.712103 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-bdce6a2c-7575-45ab-bb74-4b05fb76c9f1 tempest-VolumesSnapshotsTestJSON-1497653836 tempest-VolumesSnapshotsTestJSON-1497653836-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/fa1faaec-0158-4d02-bce3-446b3a371073" status: 200 len: 287 microversion: 2.1 time: 0.036147 Oct 17 04:00:32.712692 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 485/964] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Oct 17 04:00:32 2022] GET /compute/v2.1/os-snapshots/fa1faaec-0158-4d02-bce3-446b3a371073 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:00:32.729112 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-662ce80d-479d-461c-9ce6-2cd335860d90 tempest-VolumesSnapshotsTestJSON-1497653836 tempest-VolumesSnapshotsTestJSON-1497653836-project] Calling method '.version_select at 0x7fd72a7fa820>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:32.870728 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-662ce80d-479d-461c-9ce6-2cd335860d90 tempest-VolumesSnapshotsTestJSON-1497653836 tempest-VolumesSnapshotsTestJSON-1497653836-project] 10.222.0.16 "DELETE /compute/v2.1/os-snapshots/fa1faaec-0158-4d02-bce3-446b3a371073" status: 202 len: 0 microversion: 2.1 time: 0.145535 Oct 17 04:00:32.871340 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 480/965] 10.222.0.16 () {58 vars in 1254 bytes} [Mon Oct 17 04:00:32 2022] DELETE /compute/v2.1/os-snapshots/fa1faaec-0158-4d02-bce3-446b3a371073 => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 04:00:32.880356 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-22ec4d54-48c6-430d-82f4-f634e5b0d56a tempest-VolumesSnapshotsTestJSON-1497653836 tempest-VolumesSnapshotsTestJSON-1497653836-project] Calling method '.version_select at 0x7fd72a6f78b0>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:32.913254 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-22ec4d54-48c6-430d-82f4-f634e5b0d56a tempest-VolumesSnapshotsTestJSON-1497653836 tempest-VolumesSnapshotsTestJSON-1497653836-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/fa1faaec-0158-4d02-bce3-446b3a371073" status: 200 len: 286 microversion: 2.1 time: 0.034490 Oct 17 04:00:32.913254 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 486/966] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Oct 17 04:00:32 2022] GET /compute/v2.1/os-snapshots/fa1faaec-0158-4d02-bce3-446b3a371073 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 04:00:33.239295 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-622da3ad-d701-4286-9862-6b535e797174 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:33.239940 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-622da3ad-d701-4286-9862-6b535e797174 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:00:33.246196 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-622da3ad-d701-4286-9862-6b535e797174 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:33.246677 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-622da3ad-d701-4286-9862-6b535e797174 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:33.247108 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-622da3ad-d701-4286-9862-6b535e797174 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:33.247823 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-622da3ad-d701-4286-9862-6b535e797174 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:33.248269 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-622da3ad-d701-4286-9862-6b535e797174 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:33.248722 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-622da3ad-d701-4286-9862-6b535e797174 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:33.378768 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-622da3ad-d701-4286-9862-6b535e797174 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:33.386954 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-622da3ad-d701-4286-9862-6b535e797174 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:33.388451 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-622da3ad-d701-4286-9862-6b535e797174 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:33.389601 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-622da3ad-d701-4286-9862-6b535e797174 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6" status: 200 len: 1729 microversion: 2.20 time: 0.155671 Oct 17 04:00:33.390160 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 481/967] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 04:00:33 2022] GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:00:33.923637 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-da748704-ae4e-4c7b-aad1-017c2c56dce4 tempest-VolumesSnapshotsTestJSON-1497653836 tempest-VolumesSnapshotsTestJSON-1497653836-project] Calling method '.version_select at 0x7fd72a5c6af0>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:33.948707 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.wsgi [None req-da748704-ae4e-4c7b-aad1-017c2c56dce4 tempest-VolumesSnapshotsTestJSON-1497653836 tempest-VolumesSnapshotsTestJSON-1497653836-project] HTTP exception thrown: Snapshot fa1faaec-0158-4d02-bce3-446b3a371073 could not be found. Oct 17 04:00:33.950917 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-da748704-ae4e-4c7b-aad1-017c2c56dce4 tempest-VolumesSnapshotsTestJSON-1497653836 tempest-VolumesSnapshotsTestJSON-1497653836-project] Request method failure captured: Oct 17 04:00:33.950917 dv-cinder-815582-16-smb devstack@n-api.service[125871]: request: GET /compute/v2.1/os-snapshots/fa1faaec-0158-4d02-bce3-446b3a371073 HTTP/1.1 Oct 17 04:00:33.950917 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Accept: application/json Oct 17 04:00:33.950917 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Accept-Encoding: identity Oct 17 04:00:33.950917 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Connection: close Oct 17 04:00:33.950917 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Content-Length: 0 Oct 17 04:00:33.950917 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Content-Type: application/json Oct 17 04:00:33.950917 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Host: 10.222.0.16 Oct 17 04:00:33.950917 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Openstack-System-Scope: None Oct 17 04:00:33.950917 dv-cinder-815582-16-smb devstack@n-api.service[125871]: User-Agent: python-urllib3/1.26.12 Oct 17 04:00:33.950917 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Auth-Token: gAAAAABjTNNczVjI5DusMrtMYrMjiQ5PZGiM2TWHrmgIwQqmpISgsTpEDCYPRaEjQpPhBHby1uspEG2twBIsdGnGvYKm6rs0xa89deRAZu8j6_YvSt2T60zSY82VKypImkgWwUjrfE6kCjjVDDEKAz2YWLpjAzuhicAlf9FvQRBOjlVvUL_itAI Oct 17 04:00:33.950917 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Domain-Id: None Oct 17 04:00:33.950917 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Domain-Name: None Oct 17 04:00:33.950917 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Identity-Status: Confirmed Oct 17 04:00:33.950917 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Is-Admin-Project: True Oct 17 04:00:33.950917 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Domain-Id: default Oct 17 04:00:33.950917 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Domain-Name: Default Oct 17 04:00:33.950917 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Id: 12b00cf139f64035a58c72758c918007 Oct 17 04:00:33.950917 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1497653836 Oct 17 04:00:33.950917 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Role: reader,member Oct 17 04:00:33.950917 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Roles: reader,member Oct 17 04:00:33.952423 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/12b00cf139f64035a58c72758c918007"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/12b00cf139f64035a58c72758c918007"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/12b00cf139f64035a58c72758c918007"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_12b00cf139f64035a58c72758c918007", "adminURL": "http://10.222.0.16:8080"}]}] Oct 17 04:00:33.952423 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1497653836 Oct 17 04:00:33.952423 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant-Id: 12b00cf139f64035a58c72758c918007 Oct 17 04:00:33.952423 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1497653836 Oct 17 04:00:33.952423 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User: tempest-VolumesSnapshotsTestJSON-1497653836-project Oct 17 04:00:33.952423 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Domain-Id: default Oct 17 04:00:33.952423 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Domain-Name: Default Oct 17 04:00:33.952423 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Id: fc0fa9e345a649a08f6b48cf33dc1220 Oct 17 04:00:33.952423 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1497653836-project Oct 17 04:00:33.952423 dv-cinder-815582-16-smb devstack@n-api.service[125871]: method: Oct 17 04:00:33.952423 dv-cinder-815582-16-smb devstack@n-api.service[125871]: exception: Snapshot fa1faaec-0158-4d02-bce3-446b3a371073 could not be found. Oct 17 04:00:33.952423 dv-cinder-815582-16-smb devstack@n-api.service[125871]: action_args: {'id': 'fa1faaec-0158-4d02-bce3-446b3a371073'} Oct 17 04:00:33.952423 dv-cinder-815582-16-smb devstack@n-api.service[125871]: {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:00:33.953470 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:00:33.953470 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 17 04:00:33.953470 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 17 04:00:33.953470 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 17 04:00:33.953470 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 17 04:00:33.953470 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 17 04:00:33.953470 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 17 04:00:33.953470 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 04:00:33.953470 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 04:00:33.953470 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 04:00:33.953470 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 04:00:33.953470 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 04:00:33.953470 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 04:00:33.953470 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 04:00:33.953470 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 04:00:33.953470 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot fa1faaec-0158-4d02-bce3-446b3a371073 could not be found. (HTTP 404) (Request-ID: req-60ce3a6b-fe82-433e-911f-60dcc511e5c7) Oct 17 04:00:33.953470 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 04:00:33.953470 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:00:33.954987 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 04:00:33.954987 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:00:33.954987 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 17 04:00:33.954987 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 17 04:00:33.954987 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 04:00:33.954987 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 04:00:33.954987 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 17 04:00:33.954987 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 17 04:00:33.954987 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 04:00:33.954987 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 04:00:33.954987 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 17 04:00:33.954987 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 17 04:00:33.954987 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 17 04:00:33.954987 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 17 04:00:33.954987 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 17 04:00:33.954987 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 17 04:00:33.954987 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 04:00:33.954987 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 04:00:33.954987 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 04:00:33.956440 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 04:00:33.956440 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 04:00:33.956440 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 04:00:33.956440 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 04:00:33.956440 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 04:00:33.956440 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot fa1faaec-0158-4d02-bce3-446b3a371073 could not be found. Oct 17 04:00:33.956440 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 04:00:33.956440 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:00:33.956440 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 04:00:33.956440 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:00:33.956440 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:00:33.956440 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:00:33.956440 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:00:33.956440 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:00:33.956440 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 04:00:33.956440 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 04:00:33.956440 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:00:33.956440 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:00:33.956440 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 17 04:00:33.956440 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:00:33.957887 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot fa1faaec-0158-4d02-bce3-446b3a371073 could not be found. Oct 17 04:00:33.957887 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 04:00:33.957887 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:00:33.957887 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 04:00:33.957887 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:00:33.957887 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:00:33.957887 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:00:33.957887 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:00:33.957887 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:00:33.957887 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot fa1faaec-0158-4d02-bce3-446b3a371073 could not be found. Oct 17 04:00:33.957887 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 04:00:33.957887 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-da748704-ae4e-4c7b-aad1-017c2c56dce4 tempest-VolumesSnapshotsTestJSON-1497653836 tempest-VolumesSnapshotsTestJSON-1497653836-project] Returning 404 to user: Snapshot fa1faaec-0158-4d02-bce3-446b3a371073 could not be found. {{(pid=125871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:00:33.957887 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-da748704-ae4e-4c7b-aad1-017c2c56dce4 tempest-VolumesSnapshotsTestJSON-1497653836 tempest-VolumesSnapshotsTestJSON-1497653836-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/fa1faaec-0158-4d02-bce3-446b3a371073" status: 404 len: 111 microversion: 2.1 time: 0.033078 Oct 17 04:00:33.959782 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 487/968] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Oct 17 04:00:33 2022] GET /compute/v2.1/os-snapshots/fa1faaec-0158-4d02-bce3-446b3a371073 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 04:00:33.961249 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-ed2fca75-7813-411e-b0c8-78d948e0a687 tempest-VolumesSnapshotsTestJSON-1497653836 tempest-VolumesSnapshotsTestJSON-1497653836-project] Calling method '.version_select at 0x7fd72a7fa0d0>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:34.150443 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-ed2fca75-7813-411e-b0c8-78d948e0a687 tempest-VolumesSnapshotsTestJSON-1497653836 tempest-VolumesSnapshotsTestJSON-1497653836-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/70a63e7f-24f9-4c82-ae1f-0b974d63bbca" status: 202 len: 0 microversion: 2.1 time: 0.193073 Oct 17 04:00:34.151110 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 482/969] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Oct 17 04:00:33 2022] DELETE /compute/v2.1/os-volumes/70a63e7f-24f9-4c82-ae1f-0b974d63bbca => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 04:00:34.160018 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-b01dbf52-6553-4467-9548-e21df02a214b tempest-VolumesSnapshotsTestJSON-1497653836 tempest-VolumesSnapshotsTestJSON-1497653836-project] Calling method '.version_select at 0x7fd72a757670>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:34.217125 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-b01dbf52-6553-4467-9548-e21df02a214b tempest-VolumesSnapshotsTestJSON-1497653836 tempest-VolumesSnapshotsTestJSON-1497653836-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/70a63e7f-24f9-4c82-ae1f-0b974d63bbca" status: 200 len: 343 microversion: 2.1 time: 0.054540 Oct 17 04:00:34.217125 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 488/970] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Oct 17 04:00:34 2022] GET /compute/v2.1/os-volumes/70a63e7f-24f9-4c82-ae1f-0b974d63bbca => generated 343 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:00:34.416487 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-0d77bb1c-a8cc-48c6-a01e-76d417f8a66f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:34.417131 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-0d77bb1c-a8cc-48c6-a01e-76d417f8a66f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:00:34.423094 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0d77bb1c-a8cc-48c6-a01e-76d417f8a66f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:34.423983 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0d77bb1c-a8cc-48c6-a01e-76d417f8a66f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:34.424418 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0d77bb1c-a8cc-48c6-a01e-76d417f8a66f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:34.425377 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0d77bb1c-a8cc-48c6-a01e-76d417f8a66f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:34.425832 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0d77bb1c-a8cc-48c6-a01e-76d417f8a66f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:34.426268 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-0d77bb1c-a8cc-48c6-a01e-76d417f8a66f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:34.574309 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-0d77bb1c-a8cc-48c6-a01e-76d417f8a66f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:34.584513 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-0d77bb1c-a8cc-48c6-a01e-76d417f8a66f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:34.586098 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-0d77bb1c-a8cc-48c6-a01e-76d417f8a66f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:34.587488 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-0d77bb1c-a8cc-48c6-a01e-76d417f8a66f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6" status: 200 len: 1729 microversion: 2.20 time: 0.175716 Oct 17 04:00:34.595342 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 483/971] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 04:00:34 2022] GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6 => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:00:35.225387 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-6e909eca-90d4-4374-a06d-eaa84a4d4dfe tempest-VolumesSnapshotsTestJSON-1497653836 tempest-VolumesSnapshotsTestJSON-1497653836-project] Calling method '.version_select at 0x7fd72a6ca430>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:35.255999 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.wsgi [None req-6e909eca-90d4-4374-a06d-eaa84a4d4dfe tempest-VolumesSnapshotsTestJSON-1497653836 tempest-VolumesSnapshotsTestJSON-1497653836-project] HTTP exception thrown: Volume 70a63e7f-24f9-4c82-ae1f-0b974d63bbca could not be found. Oct 17 04:00:35.257990 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-6e909eca-90d4-4374-a06d-eaa84a4d4dfe tempest-VolumesSnapshotsTestJSON-1497653836 tempest-VolumesSnapshotsTestJSON-1497653836-project] Request method failure captured: Oct 17 04:00:35.257990 dv-cinder-815582-16-smb devstack@n-api.service[125871]: request: GET /compute/v2.1/os-volumes/70a63e7f-24f9-4c82-ae1f-0b974d63bbca HTTP/1.1 Oct 17 04:00:35.257990 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Accept: application/json Oct 17 04:00:35.257990 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Accept-Encoding: identity Oct 17 04:00:35.257990 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Connection: close Oct 17 04:00:35.257990 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Content-Length: 0 Oct 17 04:00:35.257990 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Content-Type: application/json Oct 17 04:00:35.257990 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Host: 10.222.0.16 Oct 17 04:00:35.257990 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Openstack-System-Scope: None Oct 17 04:00:35.257990 dv-cinder-815582-16-smb devstack@n-api.service[125871]: User-Agent: python-urllib3/1.26.12 Oct 17 04:00:35.257990 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Auth-Token: gAAAAABjTNNczVjI5DusMrtMYrMjiQ5PZGiM2TWHrmgIwQqmpISgsTpEDCYPRaEjQpPhBHby1uspEG2twBIsdGnGvYKm6rs0xa89deRAZu8j6_YvSt2T60zSY82VKypImkgWwUjrfE6kCjjVDDEKAz2YWLpjAzuhicAlf9FvQRBOjlVvUL_itAI Oct 17 04:00:35.257990 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Domain-Id: None Oct 17 04:00:35.257990 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Domain-Name: None Oct 17 04:00:35.257990 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Identity-Status: Confirmed Oct 17 04:00:35.257990 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Is-Admin-Project: True Oct 17 04:00:35.257990 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Domain-Id: default Oct 17 04:00:35.257990 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Domain-Name: Default Oct 17 04:00:35.257990 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Id: 12b00cf139f64035a58c72758c918007 Oct 17 04:00:35.257990 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1497653836 Oct 17 04:00:35.257990 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Role: reader,member Oct 17 04:00:35.257990 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Roles: reader,member Oct 17 04:00:35.259690 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/12b00cf139f64035a58c72758c918007"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/12b00cf139f64035a58c72758c918007"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/12b00cf139f64035a58c72758c918007"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_12b00cf139f64035a58c72758c918007", "adminURL": "http://10.222.0.16:8080"}]}] Oct 17 04:00:35.259690 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1497653836 Oct 17 04:00:35.259690 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant-Id: 12b00cf139f64035a58c72758c918007 Oct 17 04:00:35.259690 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1497653836 Oct 17 04:00:35.259690 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User: tempest-VolumesSnapshotsTestJSON-1497653836-project Oct 17 04:00:35.259690 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Domain-Id: default Oct 17 04:00:35.259690 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Domain-Name: Default Oct 17 04:00:35.259690 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Id: fc0fa9e345a649a08f6b48cf33dc1220 Oct 17 04:00:35.259690 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1497653836-project Oct 17 04:00:35.259690 dv-cinder-815582-16-smb devstack@n-api.service[125871]: method: Oct 17 04:00:35.259690 dv-cinder-815582-16-smb devstack@n-api.service[125871]: exception: Volume 70a63e7f-24f9-4c82-ae1f-0b974d63bbca could not be found. Oct 17 04:00:35.259690 dv-cinder-815582-16-smb devstack@n-api.service[125871]: action_args: {'id': '70a63e7f-24f9-4c82-ae1f-0b974d63bbca'} Oct 17 04:00:35.259690 dv-cinder-815582-16-smb devstack@n-api.service[125871]: {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:00:35.260658 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:00:35.260658 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 04:00:35.260658 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 04:00:35.260658 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 04:00:35.260658 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 04:00:35.260658 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 04:00:35.260658 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 04:00:35.260658 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 04:00:35.260658 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 04:00:35.260658 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 04:00:35.260658 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 04:00:35.260658 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 04:00:35.260658 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 04:00:35.260658 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 04:00:35.260658 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 04:00:35.260658 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 70a63e7f-24f9-4c82-ae1f-0b974d63bbca could not be found. (HTTP 404) (Request-ID: req-a6af87b3-2960-4a62-93f6-686999d1a0ca) Oct 17 04:00:35.260658 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 04:00:35.260658 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:00:35.260658 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 04:00:35.261856 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:00:35.261856 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 17 04:00:35.261856 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 17 04:00:35.261856 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 04:00:35.261856 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 04:00:35.261856 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 04:00:35.261856 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 04:00:35.261856 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 04:00:35.261856 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 04:00:35.261856 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 04:00:35.261856 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 04:00:35.261856 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 04:00:35.261856 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 04:00:35.261856 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 04:00:35.261856 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 04:00:35.261856 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 04:00:35.261856 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 04:00:35.261856 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 04:00:35.261856 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 04:00:35.263060 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 04:00:35.263060 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 04:00:35.263060 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 04:00:35.263060 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 04:00:35.263060 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 70a63e7f-24f9-4c82-ae1f-0b974d63bbca could not be found. Oct 17 04:00:35.263060 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 04:00:35.263060 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:00:35.263060 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 04:00:35.263060 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:00:35.263060 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:00:35.263060 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:00:35.263060 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:00:35.263060 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:00:35.263060 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 04:00:35.263060 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 04:00:35.263060 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:00:35.263060 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:00:35.263060 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 17 04:00:35.263060 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:00:35.268370 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 70a63e7f-24f9-4c82-ae1f-0b974d63bbca could not be found. Oct 17 04:00:35.268370 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 04:00:35.268370 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:00:35.268370 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 04:00:35.268370 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:00:35.268370 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:00:35.268370 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:00:35.268370 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:00:35.268370 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:00:35.268370 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 70a63e7f-24f9-4c82-ae1f-0b974d63bbca could not be found. Oct 17 04:00:35.268370 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 04:00:35.268370 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-6e909eca-90d4-4374-a06d-eaa84a4d4dfe tempest-VolumesSnapshotsTestJSON-1497653836 tempest-VolumesSnapshotsTestJSON-1497653836-project] Returning 404 to user: Volume 70a63e7f-24f9-4c82-ae1f-0b974d63bbca could not be found. {{(pid=125871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:00:35.268370 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-6e909eca-90d4-4374-a06d-eaa84a4d4dfe tempest-VolumesSnapshotsTestJSON-1497653836 tempest-VolumesSnapshotsTestJSON-1497653836-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/70a63e7f-24f9-4c82-ae1f-0b974d63bbca" status: 404 len: 109 microversion: 2.1 time: 0.038594 Oct 17 04:00:35.268370 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 489/972] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Oct 17 04:00:35 2022] GET /compute/v2.1/os-volumes/70a63e7f-24f9-4c82-ae1f-0b974d63bbca => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 04:00:35.276031 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-7952f7b1-8741-4f0b-9be4-d1e6b31e70fe tempest-VolumesSnapshotsTestJSON-1497653836 tempest-VolumesSnapshotsTestJSON-1497653836-project] Calling method '.version_select at 0x7fd72a5799d0>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:35.304289 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.wsgi [None req-7952f7b1-8741-4f0b-9be4-d1e6b31e70fe tempest-VolumesSnapshotsTestJSON-1497653836 tempest-VolumesSnapshotsTestJSON-1497653836-project] HTTP exception thrown: Volume 70a63e7f-24f9-4c82-ae1f-0b974d63bbca could not be found. Oct 17 04:00:35.306471 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-7952f7b1-8741-4f0b-9be4-d1e6b31e70fe tempest-VolumesSnapshotsTestJSON-1497653836 tempest-VolumesSnapshotsTestJSON-1497653836-project] Request method failure captured: Oct 17 04:00:35.306471 dv-cinder-815582-16-smb devstack@n-api.service[125872]: request: DELETE /compute/v2.1/os-volumes/70a63e7f-24f9-4c82-ae1f-0b974d63bbca HTTP/1.1 Oct 17 04:00:35.306471 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Accept: application/json Oct 17 04:00:35.306471 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Accept-Encoding: identity Oct 17 04:00:35.306471 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Connection: close Oct 17 04:00:35.306471 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Content-Length: 0 Oct 17 04:00:35.306471 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Content-Type: application/json Oct 17 04:00:35.306471 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Host: 10.222.0.16 Oct 17 04:00:35.306471 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Openstack-System-Scope: None Oct 17 04:00:35.306471 dv-cinder-815582-16-smb devstack@n-api.service[125872]: User-Agent: python-urllib3/1.26.12 Oct 17 04:00:35.306471 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Auth-Token: gAAAAABjTNNczVjI5DusMrtMYrMjiQ5PZGiM2TWHrmgIwQqmpISgsTpEDCYPRaEjQpPhBHby1uspEG2twBIsdGnGvYKm6rs0xa89deRAZu8j6_YvSt2T60zSY82VKypImkgWwUjrfE6kCjjVDDEKAz2YWLpjAzuhicAlf9FvQRBOjlVvUL_itAI Oct 17 04:00:35.306471 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Domain-Id: None Oct 17 04:00:35.306471 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Domain-Name: None Oct 17 04:00:35.306471 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Identity-Status: Confirmed Oct 17 04:00:35.306471 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Is-Admin-Project: True Oct 17 04:00:35.306471 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Domain-Id: default Oct 17 04:00:35.306471 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Domain-Name: Default Oct 17 04:00:35.306471 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Id: 12b00cf139f64035a58c72758c918007 Oct 17 04:00:35.306471 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1497653836 Oct 17 04:00:35.306471 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Role: reader,member Oct 17 04:00:35.306471 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Roles: reader,member Oct 17 04:00:35.308120 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/12b00cf139f64035a58c72758c918007"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/12b00cf139f64035a58c72758c918007"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/12b00cf139f64035a58c72758c918007"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_12b00cf139f64035a58c72758c918007", "adminURL": "http://10.222.0.16:8080"}]}] Oct 17 04:00:35.308120 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1497653836 Oct 17 04:00:35.308120 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant-Id: 12b00cf139f64035a58c72758c918007 Oct 17 04:00:35.308120 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1497653836 Oct 17 04:00:35.308120 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User: tempest-VolumesSnapshotsTestJSON-1497653836-project Oct 17 04:00:35.308120 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Domain-Id: default Oct 17 04:00:35.308120 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Domain-Name: Default Oct 17 04:00:35.308120 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Id: fc0fa9e345a649a08f6b48cf33dc1220 Oct 17 04:00:35.308120 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1497653836-project Oct 17 04:00:35.308120 dv-cinder-815582-16-smb devstack@n-api.service[125872]: method: Oct 17 04:00:35.308120 dv-cinder-815582-16-smb devstack@n-api.service[125872]: exception: Volume 70a63e7f-24f9-4c82-ae1f-0b974d63bbca could not be found. Oct 17 04:00:35.308120 dv-cinder-815582-16-smb devstack@n-api.service[125872]: action_args: {'id': '70a63e7f-24f9-4c82-ae1f-0b974d63bbca'} Oct 17 04:00:35.308120 dv-cinder-815582-16-smb devstack@n-api.service[125872]: {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:00:35.309334 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:00:35.309334 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 04:00:35.309334 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 04:00:35.309334 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 17 04:00:35.309334 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 17 04:00:35.309334 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 17 04:00:35.309334 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 17 04:00:35.309334 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 17 04:00:35.309334 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 17 04:00:35.309334 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 17 04:00:35.309334 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 17 04:00:35.309334 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 04:00:35.309334 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 04:00:35.309334 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 04:00:35.309334 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 04:00:35.309334 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 70a63e7f-24f9-4c82-ae1f-0b974d63bbca could not be found. (HTTP 404) (Request-ID: req-7db10605-b233-4229-980e-0d22dcd6256e) Oct 17 04:00:35.309334 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 04:00:35.309334 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:00:35.309334 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 04:00:35.310908 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:00:35.310908 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 17 04:00:35.310908 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 17 04:00:35.310908 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 04:00:35.310908 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 04:00:35.310908 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 04:00:35.310908 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 04:00:35.310908 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 04:00:35.310908 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 04:00:35.310908 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 04:00:35.310908 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 04:00:35.310908 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 17 04:00:35.310908 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 17 04:00:35.310908 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 17 04:00:35.310908 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 17 04:00:35.310908 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 17 04:00:35.310908 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 17 04:00:35.310908 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 17 04:00:35.310908 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 17 04:00:35.312326 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 04:00:35.312326 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 04:00:35.312326 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 04:00:35.312326 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 04:00:35.312326 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 70a63e7f-24f9-4c82-ae1f-0b974d63bbca could not be found. Oct 17 04:00:35.312326 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 04:00:35.312326 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:00:35.312326 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 04:00:35.312326 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:00:35.312326 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:00:35.312326 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:00:35.312326 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:00:35.312326 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:00:35.312326 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 04:00:35.312326 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 04:00:35.312326 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:00:35.312326 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:00:35.312326 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 17 04:00:35.312326 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:00:35.313999 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 70a63e7f-24f9-4c82-ae1f-0b974d63bbca could not be found. Oct 17 04:00:35.313999 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 04:00:35.313999 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:00:35.313999 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 04:00:35.313999 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:00:35.313999 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:00:35.313999 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:00:35.313999 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:00:35.313999 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:00:35.313999 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 70a63e7f-24f9-4c82-ae1f-0b974d63bbca could not be found. Oct 17 04:00:35.313999 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 04:00:35.313999 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-7952f7b1-8741-4f0b-9be4-d1e6b31e70fe tempest-VolumesSnapshotsTestJSON-1497653836 tempest-VolumesSnapshotsTestJSON-1497653836-project] Returning 404 to user: Volume 70a63e7f-24f9-4c82-ae1f-0b974d63bbca could not be found. {{(pid=125872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:00:35.313999 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-7952f7b1-8741-4f0b-9be4-d1e6b31e70fe tempest-VolumesSnapshotsTestJSON-1497653836 tempest-VolumesSnapshotsTestJSON-1497653836-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/70a63e7f-24f9-4c82-ae1f-0b974d63bbca" status: 404 len: 109 microversion: 2.1 time: 0.036251 Oct 17 04:00:35.313999 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 484/973] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Oct 17 04:00:35 2022] DELETE /compute/v2.1/os-volumes/70a63e7f-24f9-4c82-ae1f-0b974d63bbca => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 04:00:35.319151 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-4e3e82cc-983d-4873-9989-98bf28e595cb tempest-VolumesSnapshotsTestJSON-1497653836 tempest-VolumesSnapshotsTestJSON-1497653836-project] Calling method '.version_select at 0x7fd72a627280>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:35.347757 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.wsgi [None req-4e3e82cc-983d-4873-9989-98bf28e595cb tempest-VolumesSnapshotsTestJSON-1497653836 tempest-VolumesSnapshotsTestJSON-1497653836-project] HTTP exception thrown: Volume 70a63e7f-24f9-4c82-ae1f-0b974d63bbca could not be found. Oct 17 04:00:35.353030 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-4e3e82cc-983d-4873-9989-98bf28e595cb tempest-VolumesSnapshotsTestJSON-1497653836 tempest-VolumesSnapshotsTestJSON-1497653836-project] Request method failure captured: Oct 17 04:00:35.353030 dv-cinder-815582-16-smb devstack@n-api.service[125871]: request: GET /compute/v2.1/os-volumes/70a63e7f-24f9-4c82-ae1f-0b974d63bbca HTTP/1.1 Oct 17 04:00:35.353030 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Accept: application/json Oct 17 04:00:35.353030 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Accept-Encoding: identity Oct 17 04:00:35.353030 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Connection: close Oct 17 04:00:35.353030 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Content-Length: 0 Oct 17 04:00:35.353030 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Content-Type: application/json Oct 17 04:00:35.353030 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Host: 10.222.0.16 Oct 17 04:00:35.353030 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Openstack-System-Scope: None Oct 17 04:00:35.353030 dv-cinder-815582-16-smb devstack@n-api.service[125871]: User-Agent: python-urllib3/1.26.12 Oct 17 04:00:35.353030 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Auth-Token: gAAAAABjTNNczVjI5DusMrtMYrMjiQ5PZGiM2TWHrmgIwQqmpISgsTpEDCYPRaEjQpPhBHby1uspEG2twBIsdGnGvYKm6rs0xa89deRAZu8j6_YvSt2T60zSY82VKypImkgWwUjrfE6kCjjVDDEKAz2YWLpjAzuhicAlf9FvQRBOjlVvUL_itAI Oct 17 04:00:35.353030 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Domain-Id: None Oct 17 04:00:35.353030 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Domain-Name: None Oct 17 04:00:35.353030 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Identity-Status: Confirmed Oct 17 04:00:35.353030 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Is-Admin-Project: True Oct 17 04:00:35.353030 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Domain-Id: default Oct 17 04:00:35.353030 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Domain-Name: Default Oct 17 04:00:35.353030 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Id: 12b00cf139f64035a58c72758c918007 Oct 17 04:00:35.353030 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1497653836 Oct 17 04:00:35.353030 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Role: reader,member Oct 17 04:00:35.353030 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Roles: reader,member Oct 17 04:00:35.354414 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/12b00cf139f64035a58c72758c918007"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/12b00cf139f64035a58c72758c918007"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/12b00cf139f64035a58c72758c918007"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_12b00cf139f64035a58c72758c918007", "adminURL": "http://10.222.0.16:8080"}]}] Oct 17 04:00:35.354414 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1497653836 Oct 17 04:00:35.354414 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant-Id: 12b00cf139f64035a58c72758c918007 Oct 17 04:00:35.354414 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1497653836 Oct 17 04:00:35.354414 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User: tempest-VolumesSnapshotsTestJSON-1497653836-project Oct 17 04:00:35.354414 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Domain-Id: default Oct 17 04:00:35.354414 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Domain-Name: Default Oct 17 04:00:35.354414 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Id: fc0fa9e345a649a08f6b48cf33dc1220 Oct 17 04:00:35.354414 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1497653836-project Oct 17 04:00:35.354414 dv-cinder-815582-16-smb devstack@n-api.service[125871]: method: Oct 17 04:00:35.354414 dv-cinder-815582-16-smb devstack@n-api.service[125871]: exception: Volume 70a63e7f-24f9-4c82-ae1f-0b974d63bbca could not be found. Oct 17 04:00:35.354414 dv-cinder-815582-16-smb devstack@n-api.service[125871]: action_args: {'id': '70a63e7f-24f9-4c82-ae1f-0b974d63bbca'} Oct 17 04:00:35.354414 dv-cinder-815582-16-smb devstack@n-api.service[125871]: {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:00:35.355332 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:00:35.355332 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 04:00:35.355332 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 04:00:35.355332 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 04:00:35.355332 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 04:00:35.355332 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 04:00:35.355332 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 04:00:35.355332 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 04:00:35.355332 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 04:00:35.355332 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 04:00:35.355332 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 04:00:35.355332 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 04:00:35.355332 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 04:00:35.355332 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 04:00:35.355332 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 04:00:35.355332 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 70a63e7f-24f9-4c82-ae1f-0b974d63bbca could not be found. (HTTP 404) (Request-ID: req-77589ea6-847b-4364-bc27-9b99ff493192) Oct 17 04:00:35.355332 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 04:00:35.355332 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:00:35.355332 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 04:00:35.356751 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:00:35.356751 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 17 04:00:35.356751 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 17 04:00:35.356751 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 04:00:35.356751 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 04:00:35.356751 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 04:00:35.356751 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 04:00:35.356751 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 04:00:35.356751 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 04:00:35.356751 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 04:00:35.356751 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 04:00:35.356751 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 04:00:35.356751 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 04:00:35.356751 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 04:00:35.356751 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 04:00:35.356751 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 04:00:35.356751 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 04:00:35.356751 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 04:00:35.356751 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 04:00:35.358338 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 04:00:35.358338 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 04:00:35.358338 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 04:00:35.358338 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 04:00:35.358338 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 70a63e7f-24f9-4c82-ae1f-0b974d63bbca could not be found. Oct 17 04:00:35.358338 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 04:00:35.358338 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:00:35.358338 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 04:00:35.358338 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:00:35.358338 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:00:35.358338 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:00:35.358338 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:00:35.358338 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:00:35.358338 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 04:00:35.358338 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 04:00:35.358338 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:00:35.358338 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:00:35.358338 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 17 04:00:35.358338 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:00:35.359634 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 70a63e7f-24f9-4c82-ae1f-0b974d63bbca could not be found. Oct 17 04:00:35.359634 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 04:00:35.359634 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:00:35.359634 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 04:00:35.359634 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:00:35.359634 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:00:35.359634 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:00:35.359634 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:00:35.359634 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:00:35.359634 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 70a63e7f-24f9-4c82-ae1f-0b974d63bbca could not be found. Oct 17 04:00:35.359634 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 04:00:35.359634 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-4e3e82cc-983d-4873-9989-98bf28e595cb tempest-VolumesSnapshotsTestJSON-1497653836 tempest-VolumesSnapshotsTestJSON-1497653836-project] Returning 404 to user: Volume 70a63e7f-24f9-4c82-ae1f-0b974d63bbca could not be found. {{(pid=125871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:00:35.359634 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-4e3e82cc-983d-4873-9989-98bf28e595cb tempest-VolumesSnapshotsTestJSON-1497653836 tempest-VolumesSnapshotsTestJSON-1497653836-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/70a63e7f-24f9-4c82-ae1f-0b974d63bbca" status: 404 len: 109 microversion: 2.1 time: 0.037017 Oct 17 04:00:35.359634 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 490/974] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Oct 17 04:00:35 2022] GET /compute/v2.1/os-volumes/70a63e7f-24f9-4c82-ae1f-0b974d63bbca => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 04:00:35.614073 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-b4344483-985d-4f37-bb63-4b53da750954 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:35.615532 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-b4344483-985d-4f37-bb63-4b53da750954 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:00:35.621595 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b4344483-985d-4f37-bb63-4b53da750954 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:35.622082 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b4344483-985d-4f37-bb63-4b53da750954 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:35.626250 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b4344483-985d-4f37-bb63-4b53da750954 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:35.626250 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b4344483-985d-4f37-bb63-4b53da750954 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:35.626250 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b4344483-985d-4f37-bb63-4b53da750954 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:35.626250 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b4344483-985d-4f37-bb63-4b53da750954 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:35.796580 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-b4344483-985d-4f37-bb63-4b53da750954 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:35.807075 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-b4344483-985d-4f37-bb63-4b53da750954 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:35.816167 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-b4344483-985d-4f37-bb63-4b53da750954 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:35.816167 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-b4344483-985d-4f37-bb63-4b53da750954 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6" status: 200 len: 1729 microversion: 2.20 time: 0.201278 Oct 17 04:00:35.816167 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 485/975] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 04:00:35 2022] GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6 => generated 1729 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:00:36.177097 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [req-f3b1d4b4-f91f-4468-a3fe-223cc4b848c6 req-7d075c68-ea7d-4606-8cee-d8cd9fcfa941 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5d69048-2557-4e13-92de-3381030814e6", "name": "network-vif-plugged", "status": "completed", "tag": "4983815b-2774-4cc1-a815-084c70865641"}]} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:00:36.191037 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-f3b1d4b4-f91f-4468-a3fe-223cc4b848c6 req-7d075c68-ea7d-4606-8cee-d8cd9fcfa941 service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:36.192729 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-f3b1d4b4-f91f-4468-a3fe-223cc4b848c6 req-7d075c68-ea7d-4606-8cee-d8cd9fcfa941 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:36.193391 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-f3b1d4b4-f91f-4468-a3fe-223cc4b848c6 req-7d075c68-ea7d-4606-8cee-d8cd9fcfa941 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:36.208978 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.compute.server_external_events [req-f3b1d4b4-f91f-4468-a3fe-223cc4b848c6 req-7d075c68-ea7d-4606-8cee-d8cd9fcfa941 service nova] Creating event network-vif-plugged:4983815b-2774-4cc1-a815-084c70865641 for instance e5d69048-2557-4e13-92de-3381030814e6 on hv-cinder-81558 Oct 17 04:00:36.215314 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [req-f3b1d4b4-f91f-4468-a3fe-223cc4b848c6 req-7d075c68-ea7d-4606-8cee-d8cd9fcfa941 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044862 Oct 17 04:00:36.217036 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 491/976] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 04:00:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:00:36.851518 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-f078ed84-fcc6-4a2b-bcb2-81f1dac25f1a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:36.852805 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-f078ed84-fcc6-4a2b-bcb2-81f1dac25f1a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:00:36.861662 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f078ed84-fcc6-4a2b-bcb2-81f1dac25f1a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:36.862537 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f078ed84-fcc6-4a2b-bcb2-81f1dac25f1a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:36.863241 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f078ed84-fcc6-4a2b-bcb2-81f1dac25f1a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:36.864163 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f078ed84-fcc6-4a2b-bcb2-81f1dac25f1a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:36.864794 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f078ed84-fcc6-4a2b-bcb2-81f1dac25f1a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:36.865418 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-f078ed84-fcc6-4a2b-bcb2-81f1dac25f1a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:37.030668 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-f078ed84-fcc6-4a2b-bcb2-81f1dac25f1a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:37.038917 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-f078ed84-fcc6-4a2b-bcb2-81f1dac25f1a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:37.040382 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-f078ed84-fcc6-4a2b-bcb2-81f1dac25f1a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:37.041541 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-f078ed84-fcc6-4a2b-bcb2-81f1dac25f1a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6" status: 200 len: 1729 microversion: 2.20 time: 0.202715 Oct 17 04:00:37.042103 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 486/977] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 04:00:36 2022] GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6 => generated 1729 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:00:38.068899 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-a80d9e46-a578-4880-ab73-f2ef6862791a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:38.069671 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-a80d9e46-a578-4880-ab73-f2ef6862791a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:00:38.071620 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:00:38.076714 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a80d9e46-a578-4880-ab73-f2ef6862791a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:38.077400 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a80d9e46-a578-4880-ab73-f2ef6862791a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:38.077838 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a80d9e46-a578-4880-ab73-f2ef6862791a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:38.078866 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a80d9e46-a578-4880-ab73-f2ef6862791a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:38.079356 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a80d9e46-a578-4880-ab73-f2ef6862791a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:38.079786 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a80d9e46-a578-4880-ab73-f2ef6862791a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:38.224210 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-a80d9e46-a578-4880-ab73-f2ef6862791a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:38.235330 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-a80d9e46-a578-4880-ab73-f2ef6862791a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:38.237368 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-a80d9e46-a578-4880-ab73-f2ef6862791a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:38.238862 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-a80d9e46-a578-4880-ab73-f2ef6862791a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6" status: 200 len: 1729 microversion: 2.20 time: 0.175280 Oct 17 04:00:38.240184 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 492/978] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 04:00:38 2022] GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6 => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:00:39.265430 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-6f863283-8fea-4bf8-acbf-0f0382fa46c6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:39.266117 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-6f863283-8fea-4bf8-acbf-0f0382fa46c6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:00:39.273567 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6f863283-8fea-4bf8-acbf-0f0382fa46c6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:39.274122 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6f863283-8fea-4bf8-acbf-0f0382fa46c6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:39.274624 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6f863283-8fea-4bf8-acbf-0f0382fa46c6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:39.275413 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6f863283-8fea-4bf8-acbf-0f0382fa46c6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:39.275933 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6f863283-8fea-4bf8-acbf-0f0382fa46c6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:39.276425 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-6f863283-8fea-4bf8-acbf-0f0382fa46c6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:39.413440 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-6f863283-8fea-4bf8-acbf-0f0382fa46c6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:39.421769 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-6f863283-8fea-4bf8-acbf-0f0382fa46c6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:39.423634 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-6f863283-8fea-4bf8-acbf-0f0382fa46c6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:39.424964 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-6f863283-8fea-4bf8-acbf-0f0382fa46c6 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6" status: 200 len: 1729 microversion: 2.20 time: 0.163501 Oct 17 04:00:39.425518 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 487/979] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 04:00:39 2022] GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:00:40.449872 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-4942e5fd-628c-42fb-b44d-48d80787b21e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:40.450480 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-4942e5fd-628c-42fb-b44d-48d80787b21e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:00:40.457724 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-4942e5fd-628c-42fb-b44d-48d80787b21e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:40.458243 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-4942e5fd-628c-42fb-b44d-48d80787b21e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:40.458678 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-4942e5fd-628c-42fb-b44d-48d80787b21e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:40.459489 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-4942e5fd-628c-42fb-b44d-48d80787b21e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:40.459951 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-4942e5fd-628c-42fb-b44d-48d80787b21e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:40.460373 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-4942e5fd-628c-42fb-b44d-48d80787b21e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:40.595303 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-4942e5fd-628c-42fb-b44d-48d80787b21e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:40.605983 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-4942e5fd-628c-42fb-b44d-48d80787b21e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:40.607746 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-4942e5fd-628c-42fb-b44d-48d80787b21e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:40.608912 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-4942e5fd-628c-42fb-b44d-48d80787b21e tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6" status: 200 len: 1716 microversion: 2.20 time: 0.162926 Oct 17 04:00:40.610305 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 493/980] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 04:00:40 2022] GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6 => generated 1716 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 04:00:41.063107 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-99a87845-c941-49af-a49e-6d27897fe49b tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:41.064182 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-99a87845-c941-49af-a49e-6d27897fe49b tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] [instance: d471c80c-12be-4e18-89d6-d64601602d39] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:00:41.071345 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-99a87845-c941-49af-a49e-6d27897fe49b tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:41.071839 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-99a87845-c941-49af-a49e-6d27897fe49b tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:41.072295 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-99a87845-c941-49af-a49e-6d27897fe49b tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:41.073004 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-99a87845-c941-49af-a49e-6d27897fe49b tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:41.073245 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [req-d1dd1d4b-08ac-4e97-a62c-1f107502982c req-d4da3fb0-0e63-4007-b4d4-9b76327086e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d471c80c-12be-4e18-89d6-d64601602d39", "tag": "63565771-2da1-4fe4-a238-2f393636b21d"}]} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:00:41.073866 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-99a87845-c941-49af-a49e-6d27897fe49b tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:41.074466 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-99a87845-c941-49af-a49e-6d27897fe49b tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:41.083630 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-d1dd1d4b-08ac-4e97-a62c-1f107502982c req-d4da3fb0-0e63-4007-b4d4-9b76327086e2 service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:41.084301 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-d1dd1d4b-08ac-4e97-a62c-1f107502982c req-d4da3fb0-0e63-4007-b4d4-9b76327086e2 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:41.084851 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-d1dd1d4b-08ac-4e97-a62c-1f107502982c req-d4da3fb0-0e63-4007-b4d4-9b76327086e2 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:41.103718 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-99a87845-c941-49af-a49e-6d27897fe49b tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] [instance: d471c80c-12be-4e18-89d6-d64601602d39] Going to try to terminate instance {{(pid=125872) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 04:00:41.114060 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.compute.server_external_events [req-d1dd1d4b-08ac-4e97-a62c-1f107502982c req-d4da3fb0-0e63-4007-b4d4-9b76327086e2 service nova] Creating event network-changed:63565771-2da1-4fe4-a238-2f393636b21d for instance d471c80c-12be-4e18-89d6-d64601602d39 on hv-cinder-81558 Oct 17 04:00:41.121806 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [req-d1dd1d4b-08ac-4e97-a62c-1f107502982c req-d4da3fb0-0e63-4007-b4d4-9b76327086e2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052806 Oct 17 04:00:41.122428 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 494/981] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 04:00:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 04:00:41.479768 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-99a87845-c941-49af-a49e-6d27897fe49b tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39" status: 204 len: 0 microversion: 2.1 time: 0.420232 Oct 17 04:00:41.480776 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 488/982] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 17 04:00:41 2022] DELETE /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 04:00:41.491333 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-ed515a99-e28e-4d71-bc3a-31b81dcc09f3 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:41.491790 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-ed515a99-e28e-4d71-bc3a-31b81dcc09f3 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] [instance: d471c80c-12be-4e18-89d6-d64601602d39] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:00:41.500767 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ed515a99-e28e-4d71-bc3a-31b81dcc09f3 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:41.501398 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ed515a99-e28e-4d71-bc3a-31b81dcc09f3 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:41.502145 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ed515a99-e28e-4d71-bc3a-31b81dcc09f3 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:41.502982 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ed515a99-e28e-4d71-bc3a-31b81dcc09f3 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:41.503527 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ed515a99-e28e-4d71-bc3a-31b81dcc09f3 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:41.504027 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ed515a99-e28e-4d71-bc3a-31b81dcc09f3 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:41.653964 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-ed515a99-e28e-4d71-bc3a-31b81dcc09f3 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b22f27c7144a3d96f41747473fe646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0a418ceb742fdb01c98c5d58424a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:41.663385 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-ed515a99-e28e-4d71-bc3a-31b81dcc09f3 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] 10.222.0.16 "GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39" status: 200 len: 1566 microversion: 2.1 time: 0.178202 Oct 17 04:00:41.677738 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 495/983] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 04:00:41 2022] GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39 => generated 1566 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:00:42.689809 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-b755ea3d-c4db-49e4-8ab5-eb1a7cc97090 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:42.691032 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-b755ea3d-c4db-49e4-8ab5-eb1a7cc97090 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] [instance: d471c80c-12be-4e18-89d6-d64601602d39] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:00:42.698525 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b755ea3d-c4db-49e4-8ab5-eb1a7cc97090 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:42.699231 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b755ea3d-c4db-49e4-8ab5-eb1a7cc97090 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:42.699659 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b755ea3d-c4db-49e4-8ab5-eb1a7cc97090 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:42.700372 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b755ea3d-c4db-49e4-8ab5-eb1a7cc97090 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:42.700829 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b755ea3d-c4db-49e4-8ab5-eb1a7cc97090 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:42.701255 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-b755ea3d-c4db-49e4-8ab5-eb1a7cc97090 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:42.892906 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-b755ea3d-c4db-49e4-8ab5-eb1a7cc97090 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b22f27c7144a3d96f41747473fe646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0a418ceb742fdb01c98c5d58424a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:42.901776 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-b755ea3d-c4db-49e4-8ab5-eb1a7cc97090 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] 10.222.0.16 "GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39" status: 200 len: 1566 microversion: 2.1 time: 0.217167 Oct 17 04:00:42.902430 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 489/984] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 04:00:42 2022] GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39 => generated 1566 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:00:43.511125 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [req-7b4e6794-b309-43c8-af6b-d18e4b817da4 req-e6d4c451-5295-48e0-8af7-471acfb8ffaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d471c80c-12be-4e18-89d6-d64601602d39", "name": "network-vif-deleted", "tag": "63565771-2da1-4fe4-a238-2f393636b21d"}]} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:00:43.523458 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-7b4e6794-b309-43c8-af6b-d18e4b817da4 req-e6d4c451-5295-48e0-8af7-471acfb8ffaa service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:43.524097 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-7b4e6794-b309-43c8-af6b-d18e4b817da4 req-e6d4c451-5295-48e0-8af7-471acfb8ffaa service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:43.524541 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-7b4e6794-b309-43c8-af6b-d18e4b817da4 req-e6d4c451-5295-48e0-8af7-471acfb8ffaa service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:43.537380 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.compute.server_external_events [req-7b4e6794-b309-43c8-af6b-d18e4b817da4 req-e6d4c451-5295-48e0-8af7-471acfb8ffaa service nova] Creating event network-vif-deleted:63565771-2da1-4fe4-a238-2f393636b21d for instance d471c80c-12be-4e18-89d6-d64601602d39 on hv-cinder-81558 Oct 17 04:00:43.542646 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [req-7b4e6794-b309-43c8-af6b-d18e4b817da4 req-e6d4c451-5295-48e0-8af7-471acfb8ffaa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035156 Oct 17 04:00:43.543271 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 496/985] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 04:00:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:00:43.926401 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-350fb61a-ca6f-4d23-b15e-083e982c546f tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:43.927070 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-350fb61a-ca6f-4d23-b15e-083e982c546f tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] [instance: d471c80c-12be-4e18-89d6-d64601602d39] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:00:43.936119 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-350fb61a-ca6f-4d23-b15e-083e982c546f tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:43.936119 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-350fb61a-ca6f-4d23-b15e-083e982c546f tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:43.936119 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-350fb61a-ca6f-4d23-b15e-083e982c546f tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:43.936660 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-350fb61a-ca6f-4d23-b15e-083e982c546f tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:43.936892 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-350fb61a-ca6f-4d23-b15e-083e982c546f tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:43.937402 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-350fb61a-ca6f-4d23-b15e-083e982c546f tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:44.011654 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-350fb61a-ca6f-4d23-b15e-083e982c546f tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b22f27c7144a3d96f41747473fe646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0a418ceb742fdb01c98c5d58424a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:00:44.019589 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-350fb61a-ca6f-4d23-b15e-083e982c546f tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] 10.222.0.16 "GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39" status: 200 len: 1219 microversion: 2.1 time: 0.098069 Oct 17 04:00:44.020688 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 490/986] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 04:00:43 2022] GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39 => generated 1219 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:00:45.045356 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-559f9d4f-e887-47ff-9e22-833f6bcef820 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:45.046067 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-559f9d4f-e887-47ff-9e22-833f6bcef820 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] [instance: d471c80c-12be-4e18-89d6-d64601602d39] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:00:45.052293 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-559f9d4f-e887-47ff-9e22-833f6bcef820 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:45.052784 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-559f9d4f-e887-47ff-9e22-833f6bcef820 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:45.053221 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-559f9d4f-e887-47ff-9e22-833f6bcef820 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:45.053920 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-559f9d4f-e887-47ff-9e22-833f6bcef820 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:00:45.054388 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-559f9d4f-e887-47ff-9e22-833f6bcef820 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:00:45.054818 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-559f9d4f-e887-47ff-9e22-833f6bcef820 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:00:45.068417 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.wsgi [None req-559f9d4f-e887-47ff-9e22-833f6bcef820 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] HTTP exception thrown: Instance d471c80c-12be-4e18-89d6-d64601602d39 could not be found. Oct 17 04:00:45.070025 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-559f9d4f-e887-47ff-9e22-833f6bcef820 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Request method failure captured: Oct 17 04:00:45.070025 dv-cinder-815582-16-smb devstack@n-api.service[125871]: request: GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39 HTTP/1.1 Oct 17 04:00:45.070025 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Accept: application/json Oct 17 04:00:45.070025 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Accept-Encoding: identity Oct 17 04:00:45.070025 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Connection: close Oct 17 04:00:45.070025 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Content-Length: 0 Oct 17 04:00:45.070025 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Content-Type: application/json Oct 17 04:00:45.070025 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Host: 10.222.0.16 Oct 17 04:00:45.070025 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Openstack-System-Scope: None Oct 17 04:00:45.070025 dv-cinder-815582-16-smb devstack@n-api.service[125871]: User-Agent: python-urllib3/1.26.12 Oct 17 04:00:45.070025 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Auth-Token: gAAAAABjTNJHqhkI0D7REJkdevS_hePIPkJZMz_g0Gny1ihiy2Uvaq93p7-CIXyXDdCN-7MAoz6W_NjAKzQZCF-_jmvyZVVA-66UeadHzq6FvNibpGTBws2lJyaUTRkdtx70NjqrXCT4h7HmVqEi9mi47mLD6sfWmtkjGeKXAU-SlGAfKQvKjyU Oct 17 04:00:45.070025 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Domain-Id: None Oct 17 04:00:45.070025 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Domain-Name: None Oct 17 04:00:45.070025 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Identity-Status: Confirmed Oct 17 04:00:45.070025 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Is-Admin-Project: True Oct 17 04:00:45.070025 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Domain-Id: default Oct 17 04:00:45.070025 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Domain-Name: Default Oct 17 04:00:45.070025 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Id: 0ba0a418ceb742fdb01c98c5d58424a1 Oct 17 04:00:45.070025 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Name: tempest-TestShelveInstance-199473557 Oct 17 04:00:45.070025 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Role: reader,member Oct 17 04:00:45.070025 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Roles: reader,member Oct 17 04:00:45.071677 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0ba0a418ceb742fdb01c98c5d58424a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0ba0a418ceb742fdb01c98c5d58424a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0ba0a418ceb742fdb01c98c5d58424a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0ba0a418ceb742fdb01c98c5d58424a1", "adminURL": "http://10.222.0.16:8080"}]}] Oct 17 04:00:45.071677 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant: tempest-TestShelveInstance-199473557 Oct 17 04:00:45.071677 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant-Id: 0ba0a418ceb742fdb01c98c5d58424a1 Oct 17 04:00:45.071677 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant-Name: tempest-TestShelveInstance-199473557 Oct 17 04:00:45.071677 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User: tempest-TestShelveInstance-199473557-project Oct 17 04:00:45.071677 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Domain-Id: default Oct 17 04:00:45.071677 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Domain-Name: Default Oct 17 04:00:45.071677 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Id: 87b22f27c7144a3d96f41747473fe646 Oct 17 04:00:45.071677 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Name: tempest-TestShelveInstance-199473557-project Oct 17 04:00:45.071677 dv-cinder-815582-16-smb devstack@n-api.service[125871]: method: > Oct 17 04:00:45.071677 dv-cinder-815582-16-smb devstack@n-api.service[125871]: exception: Instance d471c80c-12be-4e18-89d6-d64601602d39 could not be found. Oct 17 04:00:45.071677 dv-cinder-815582-16-smb devstack@n-api.service[125871]: action_args: {'id': 'd471c80c-12be-4e18-89d6-d64601602d39'} Oct 17 04:00:45.072757 dv-cinder-815582-16-smb devstack@n-api.service[125871]: {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:00:45.072757 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:00:45.072757 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 04:00:45.072757 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 04:00:45.072757 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 04:00:45.072757 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 04:00:45.072757 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 04:00:45.072757 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 04:00:45.072757 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 04:00:45.072757 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 04:00:45.072757 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d471c80c-12be-4e18-89d6-d64601602d39 could not be found. Oct 17 04:00:45.072757 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 04:00:45.072757 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:00:45.072757 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 04:00:45.072757 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:00:45.072757 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:00:45.072757 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:00:45.072757 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:00:45.072757 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:00:45.072757 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:00:45.074342 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:00:45.074342 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 04:00:45.074342 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 04:00:45.074342 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 04:00:45.074342 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 04:00:45.074342 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 04:00:45.074342 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:00:45.074342 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d471c80c-12be-4e18-89d6-d64601602d39 could not be found. Oct 17 04:00:45.074342 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 04:00:45.074342 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:00:45.074342 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 04:00:45.074342 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:00:45.074342 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:00:45.074342 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:00:45.074342 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:00:45.074342 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:00:45.074342 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d471c80c-12be-4e18-89d6-d64601602d39 could not be found. Oct 17 04:00:45.074342 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 04:00:45.075937 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-559f9d4f-e887-47ff-9e22-833f6bcef820 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Returning 404 to user: Instance d471c80c-12be-4e18-89d6-d64601602d39 could not be found. {{(pid=125871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:00:45.075937 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-559f9d4f-e887-47ff-9e22-833f6bcef820 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] 10.222.0.16 "GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39" status: 404 len: 111 microversion: 2.1 time: 0.031013 Oct 17 04:00:45.075937 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 497/987] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 04:00:45 2022] GET /compute/v2.1/servers/d471c80c-12be-4e18-89d6-d64601602d39 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 04:00:45.343554 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-588d7d7c-827b-4be4-a82b-2050d1cbb600 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] Calling method '.version_select at 0x7fd72a76be50>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:00:45.408492 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-588d7d7c-827b-4be4-a82b-2050d1cbb600 tempest-TestShelveInstance-199473557 tempest-TestShelveInstance-199473557-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-369098111" status: 202 len: 0 microversion: 2.1 time: 0.068967 Oct 17 04:00:45.409081 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 491/988] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Oct 17 04:00:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-369098111 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 04:01:10.081779 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-df789aa3-e2a3-43b5-98e8-0b27e5fbb880 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:01:10.083940 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-df789aa3-e2a3-43b5-98e8-0b27e5fbb880 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:01:10.086709 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_api:SELECT=11 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:01:10.087574 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_cell1:SELECT=84,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:01:10.092366 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-df789aa3-e2a3-43b5-98e8-0b27e5fbb880 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:01:10.092849 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-df789aa3-e2a3-43b5-98e8-0b27e5fbb880 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:01:10.093287 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-df789aa3-e2a3-43b5-98e8-0b27e5fbb880 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:01:10.093986 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-df789aa3-e2a3-43b5-98e8-0b27e5fbb880 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:01:10.094440 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-df789aa3-e2a3-43b5-98e8-0b27e5fbb880 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:01:10.095048 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-df789aa3-e2a3-43b5-98e8-0b27e5fbb880 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:01:10.127000 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-df789aa3-e2a3-43b5-98e8-0b27e5fbb880 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049006 Oct 17 04:01:10.127590 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 498/989] 10.222.0.16 () {60 vars in 1343 bytes} [Mon Oct 17 04:01:10 2022] GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:01:10.190852 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-5eaf5834-9564-457d-b1bb-fa4889f8d1fb tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:01:10.191379 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-5eaf5834-9564-457d-b1bb-fa4889f8d1fb tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:01:10.195138 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:01:10.195899 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:01:10.199544 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-5eaf5834-9564-457d-b1bb-fa4889f8d1fb tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:01:10.200023 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-5eaf5834-9564-457d-b1bb-fa4889f8d1fb tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:01:10.200454 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-5eaf5834-9564-457d-b1bb-fa4889f8d1fb tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:01:10.201146 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-5eaf5834-9564-457d-b1bb-fa4889f8d1fb tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:01:10.201593 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-5eaf5834-9564-457d-b1bb-fa4889f8d1fb tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:01:10.202013 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-5eaf5834-9564-457d-b1bb-fa4889f8d1fb tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:01:10.231745 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-5eaf5834-9564-457d-b1bb-fa4889f8d1fb tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Going to try to terminate instance {{(pid=125872) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 04:01:10.505273 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-5eaf5834-9564-457d-b1bb-fa4889f8d1fb tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6" status: 204 len: 0 microversion: 2.20 time: 0.318030 Oct 17 04:01:10.505875 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 492/990] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Oct 17 04:01:10 2022] DELETE /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 04:01:10.515281 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-dec94dae-b11f-4a9a-a0bf-bd3dd37614f5 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:01:10.520520 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-dec94dae-b11f-4a9a-a0bf-bd3dd37614f5 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:01:10.522665 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-dec94dae-b11f-4a9a-a0bf-bd3dd37614f5 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:01:10.523165 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-dec94dae-b11f-4a9a-a0bf-bd3dd37614f5 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:01:10.524313 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-dec94dae-b11f-4a9a-a0bf-bd3dd37614f5 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:01:10.525211 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-dec94dae-b11f-4a9a-a0bf-bd3dd37614f5 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:01:10.525677 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-dec94dae-b11f-4a9a-a0bf-bd3dd37614f5 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:01:10.526119 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-dec94dae-b11f-4a9a-a0bf-bd3dd37614f5 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:01:10.659701 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-dec94dae-b11f-4a9a-a0bf-bd3dd37614f5 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:01:10.669089 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-dec94dae-b11f-4a9a-a0bf-bd3dd37614f5 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:01:10.673856 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-dec94dae-b11f-4a9a-a0bf-bd3dd37614f5 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:01:10.673856 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-dec94dae-b11f-4a9a-a0bf-bd3dd37614f5 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6" status: 200 len: 1722 microversion: 2.20 time: 0.161051 Oct 17 04:01:10.673856 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 499/991] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 04:01:10 2022] GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:01:11.698368 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-8e2fb10e-a1bb-4f3e-9717-ed9b6f66d05d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:01:11.699076 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-8e2fb10e-a1bb-4f3e-9717-ed9b6f66d05d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:01:11.706449 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8e2fb10e-a1bb-4f3e-9717-ed9b6f66d05d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:01:11.706996 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8e2fb10e-a1bb-4f3e-9717-ed9b6f66d05d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:01:11.707469 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8e2fb10e-a1bb-4f3e-9717-ed9b6f66d05d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:01:11.708166 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8e2fb10e-a1bb-4f3e-9717-ed9b6f66d05d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:01:11.708622 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8e2fb10e-a1bb-4f3e-9717-ed9b6f66d05d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:01:11.709048 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-8e2fb10e-a1bb-4f3e-9717-ed9b6f66d05d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:01:11.954242 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-8e2fb10e-a1bb-4f3e-9717-ed9b6f66d05d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:01:11.963249 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-8e2fb10e-a1bb-4f3e-9717-ed9b6f66d05d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:01:11.964805 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-8e2fb10e-a1bb-4f3e-9717-ed9b6f66d05d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:01:11.966056 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-8e2fb10e-a1bb-4f3e-9717-ed9b6f66d05d tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6" status: 200 len: 1722 microversion: 2.20 time: 0.272484 Oct 17 04:01:11.966688 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 493/992] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 04:01:11 2022] GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6 => generated 1722 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:01:12.839496 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [req-2007bf30-8f2a-4348-9def-42710a78fe63 req-1d913490-ba9e-4fef-8305-6b791490f1f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5d69048-2557-4e13-92de-3381030814e6", "name": "network-vif-deleted", "tag": "4983815b-2774-4cc1-a815-084c70865641"}]} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:01:12.852798 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-2007bf30-8f2a-4348-9def-42710a78fe63 req-1d913490-ba9e-4fef-8305-6b791490f1f5 service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:01:12.853602 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-2007bf30-8f2a-4348-9def-42710a78fe63 req-1d913490-ba9e-4fef-8305-6b791490f1f5 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:01:12.854281 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-2007bf30-8f2a-4348-9def-42710a78fe63 req-1d913490-ba9e-4fef-8305-6b791490f1f5 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:01:12.869905 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.compute.server_external_events [req-2007bf30-8f2a-4348-9def-42710a78fe63 req-1d913490-ba9e-4fef-8305-6b791490f1f5 service nova] Creating event network-vif-deleted:4983815b-2774-4cc1-a815-084c70865641 for instance e5d69048-2557-4e13-92de-3381030814e6 on hv-cinder-81558 Oct 17 04:01:12.875583 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [req-2007bf30-8f2a-4348-9def-42710a78fe63 req-1d913490-ba9e-4fef-8305-6b791490f1f5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039548 Oct 17 04:01:12.876379 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 500/993] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 04:01:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:01:12.998891 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-4dcf72c7-f5d7-4d74-9a31-0f9e8b487594 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:01:12.999607 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-4dcf72c7-f5d7-4d74-9a31-0f9e8b487594 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:01:13.006636 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-4dcf72c7-f5d7-4d74-9a31-0f9e8b487594 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:01:13.007348 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-4dcf72c7-f5d7-4d74-9a31-0f9e8b487594 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:01:13.007822 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-4dcf72c7-f5d7-4d74-9a31-0f9e8b487594 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:01:13.008533 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-4dcf72c7-f5d7-4d74-9a31-0f9e8b487594 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:01:13.008994 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-4dcf72c7-f5d7-4d74-9a31-0f9e8b487594 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:01:13.009421 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-4dcf72c7-f5d7-4d74-9a31-0f9e8b487594 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:01:13.100095 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-4dcf72c7-f5d7-4d74-9a31-0f9e8b487594 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:01:13.112220 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-4dcf72c7-f5d7-4d74-9a31-0f9e8b487594 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:01:13.115424 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-4dcf72c7-f5d7-4d74-9a31-0f9e8b487594 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67fe62eeb9d043a59baa93def8d43265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301e8558e0148a481982b776c91e839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:01:13.115982 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-4dcf72c7-f5d7-4d74-9a31-0f9e8b487594 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6" status: 200 len: 1365 microversion: 2.20 time: 0.128100 Oct 17 04:01:13.124578 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 494/994] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 04:01:12 2022] GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6 => generated 1365 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:01:14.142099 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-346095f2-59fd-4b28-ac33-f1b288aa5c0a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:01:14.143074 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-346095f2-59fd-4b28-ac33-f1b288aa5c0a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:01:14.149491 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-346095f2-59fd-4b28-ac33-f1b288aa5c0a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:01:14.149984 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-346095f2-59fd-4b28-ac33-f1b288aa5c0a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:01:14.150425 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-346095f2-59fd-4b28-ac33-f1b288aa5c0a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:01:14.151135 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-346095f2-59fd-4b28-ac33-f1b288aa5c0a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:01:14.151624 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-346095f2-59fd-4b28-ac33-f1b288aa5c0a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:01:14.152056 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-346095f2-59fd-4b28-ac33-f1b288aa5c0a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:01:14.165915 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.wsgi [None req-346095f2-59fd-4b28-ac33-f1b288aa5c0a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] HTTP exception thrown: Instance e5d69048-2557-4e13-92de-3381030814e6 could not be found. Oct 17 04:01:14.167552 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-346095f2-59fd-4b28-ac33-f1b288aa5c0a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Request method failure captured: Oct 17 04:01:14.167552 dv-cinder-815582-16-smb devstack@n-api.service[125871]: request: GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6 HTTP/1.1 Oct 17 04:01:14.167552 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Accept: application/json Oct 17 04:01:14.167552 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Accept-Encoding: identity Oct 17 04:01:14.167552 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Connection: close Oct 17 04:01:14.167552 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Content-Length: 0 Oct 17 04:01:14.167552 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Content-Type: application/json Oct 17 04:01:14.167552 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Host: 10.222.0.16 Oct 17 04:01:14.167552 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Openstack-System-Scope: None Oct 17 04:01:14.167552 dv-cinder-815582-16-smb devstack@n-api.service[125871]: User-Agent: python-urllib3/1.26.12 Oct 17 04:01:14.167552 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Auth-Token: gAAAAABjTNIfzfnfmWkMHvBxR2mN22jJ3POuCUUIzn-IRWM1bgN5ZquLGdB_CZMe9aZfDERBL4l0zV3ez1mejdg2GIcxV3KbJ4y2MPhGNW4ETthpFHK__eMgAUq4xi_0AyAq2jFPQ8FnHVgFK3v8-BNe07aI9YNG65Qgj4loEcoGjf5VYTsM-0g Oct 17 04:01:14.167552 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Domain-Id: None Oct 17 04:01:14.167552 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Domain-Name: None Oct 17 04:01:14.167552 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Identity-Status: Confirmed Oct 17 04:01:14.167552 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Is-Admin-Project: True Oct 17 04:01:14.167552 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Openstack-Nova-Api-Version: 2.20 Oct 17 04:01:14.167552 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Domain-Id: default Oct 17 04:01:14.167552 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Domain-Name: Default Oct 17 04:01:14.167552 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Id: 2301e8558e0148a481982b776c91e839 Oct 17 04:01:14.167552 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-83438865 Oct 17 04:01:14.167552 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Role: reader,member Oct 17 04:01:14.167552 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Roles: reader,member Oct 17 04:01:14.169371 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2301e8558e0148a481982b776c91e839"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2301e8558e0148a481982b776c91e839"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2301e8558e0148a481982b776c91e839"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2301e8558e0148a481982b776c91e839", "adminURL": "http://10.222.0.16:8080"}]}] Oct 17 04:01:14.169371 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant: tempest-AttachVolumeShelveTestJSON-83438865 Oct 17 04:01:14.169371 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant-Id: 2301e8558e0148a481982b776c91e839 Oct 17 04:01:14.169371 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-83438865 Oct 17 04:01:14.169371 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User: tempest-AttachVolumeShelveTestJSON-83438865-project Oct 17 04:01:14.169371 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Domain-Id: default Oct 17 04:01:14.169371 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Domain-Name: Default Oct 17 04:01:14.169371 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Id: 67fe62eeb9d043a59baa93def8d43265 Oct 17 04:01:14.169371 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Name: tempest-AttachVolumeShelveTestJSON-83438865-project Oct 17 04:01:14.169371 dv-cinder-815582-16-smb devstack@n-api.service[125871]: method: > Oct 17 04:01:14.169371 dv-cinder-815582-16-smb devstack@n-api.service[125871]: exception: Instance e5d69048-2557-4e13-92de-3381030814e6 could not be found. Oct 17 04:01:14.169371 dv-cinder-815582-16-smb devstack@n-api.service[125871]: action_args: {'id': 'e5d69048-2557-4e13-92de-3381030814e6'} Oct 17 04:01:14.170373 dv-cinder-815582-16-smb devstack@n-api.service[125871]: {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:01:14.170373 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:01:14.170373 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 04:01:14.170373 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 04:01:14.170373 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 04:01:14.170373 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 04:01:14.170373 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 04:01:14.170373 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 04:01:14.170373 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 04:01:14.170373 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 04:01:14.170373 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5d69048-2557-4e13-92de-3381030814e6 could not be found. Oct 17 04:01:14.170373 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 04:01:14.170373 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:01:14.170373 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 04:01:14.170373 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:01:14.170373 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:01:14.170373 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:01:14.170373 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:01:14.170373 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:01:14.170373 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:01:14.172089 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:01:14.172089 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 04:01:14.172089 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 04:01:14.172089 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 04:01:14.172089 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 04:01:14.172089 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 04:01:14.172089 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:01:14.172089 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5d69048-2557-4e13-92de-3381030814e6 could not be found. Oct 17 04:01:14.172089 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 04:01:14.172089 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:01:14.172089 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 04:01:14.172089 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:01:14.172089 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:01:14.172089 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:01:14.172089 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:01:14.172089 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:01:14.172089 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5d69048-2557-4e13-92de-3381030814e6 could not be found. Oct 17 04:01:14.172089 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 04:01:14.173704 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-346095f2-59fd-4b28-ac33-f1b288aa5c0a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Returning 404 to user: Instance e5d69048-2557-4e13-92de-3381030814e6 could not be found. {{(pid=125871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:01:14.173704 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-346095f2-59fd-4b28-ac33-f1b288aa5c0a tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6" status: 404 len: 111 microversion: 2.20 time: 0.031951 Oct 17 04:01:14.173704 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 501/995] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 04:01:14 2022] GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 04:01:14.178483 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-7ca9f96f-501e-4b72-b0bd-751b038dbd73 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '.version_select at 0x7fd72a7ceee0>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:01:14.254448 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-7ca9f96f-501e-4b72-b0bd-751b038dbd73 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-797351937" status: 204 len: 0 microversion: 2.20 time: 0.079676 Oct 17 04:01:14.255028 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 495/996] 10.222.0.16 () {60 vars in 1259 bytes} [Mon Oct 17 04:01:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-797351937 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 04:01:16.519145 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-3ee1b529-10b3-4f65-9ab4-689514d09fdf tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:01:16.519668 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-3ee1b529-10b3-4f65-9ab4-689514d09fdf tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:01:16.526580 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3ee1b529-10b3-4f65-9ab4-689514d09fdf tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:01:16.527070 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3ee1b529-10b3-4f65-9ab4-689514d09fdf tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:01:16.527544 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3ee1b529-10b3-4f65-9ab4-689514d09fdf tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:01:16.528230 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3ee1b529-10b3-4f65-9ab4-689514d09fdf tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:01:16.528685 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3ee1b529-10b3-4f65-9ab4-689514d09fdf tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:01:16.529110 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3ee1b529-10b3-4f65-9ab4-689514d09fdf tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:01:16.542848 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.wsgi [None req-3ee1b529-10b3-4f65-9ab4-689514d09fdf tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] HTTP exception thrown: Instance e5d69048-2557-4e13-92de-3381030814e6 could not be found. Oct 17 04:01:16.544456 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-3ee1b529-10b3-4f65-9ab4-689514d09fdf tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Request method failure captured: Oct 17 04:01:16.544456 dv-cinder-815582-16-smb devstack@n-api.service[125871]: request: DELETE /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6 HTTP/1.1 Oct 17 04:01:16.544456 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Accept: application/json Oct 17 04:01:16.544456 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Accept-Encoding: identity Oct 17 04:01:16.544456 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Connection: close Oct 17 04:01:16.544456 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Content-Length: 0 Oct 17 04:01:16.544456 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Content-Type: application/json Oct 17 04:01:16.544456 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Host: 10.222.0.16 Oct 17 04:01:16.544456 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Openstack-System-Scope: None Oct 17 04:01:16.544456 dv-cinder-815582-16-smb devstack@n-api.service[125871]: User-Agent: python-urllib3/1.26.12 Oct 17 04:01:16.544456 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Auth-Token: gAAAAABjTNIfzfnfmWkMHvBxR2mN22jJ3POuCUUIzn-IRWM1bgN5ZquLGdB_CZMe9aZfDERBL4l0zV3ez1mejdg2GIcxV3KbJ4y2MPhGNW4ETthpFHK__eMgAUq4xi_0AyAq2jFPQ8FnHVgFK3v8-BNe07aI9YNG65Qgj4loEcoGjf5VYTsM-0g Oct 17 04:01:16.544456 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Domain-Id: None Oct 17 04:01:16.544456 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Domain-Name: None Oct 17 04:01:16.544456 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Identity-Status: Confirmed Oct 17 04:01:16.544456 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Is-Admin-Project: True Oct 17 04:01:16.544456 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Openstack-Nova-Api-Version: 2.20 Oct 17 04:01:16.544456 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Domain-Id: default Oct 17 04:01:16.544456 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Domain-Name: Default Oct 17 04:01:16.544456 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Id: 2301e8558e0148a481982b776c91e839 Oct 17 04:01:16.544456 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-83438865 Oct 17 04:01:16.544456 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Role: reader,member Oct 17 04:01:16.544456 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Roles: reader,member Oct 17 04:01:16.549478 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2301e8558e0148a481982b776c91e839"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2301e8558e0148a481982b776c91e839"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2301e8558e0148a481982b776c91e839"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2301e8558e0148a481982b776c91e839", "adminURL": "http://10.222.0.16:8080"}]}] Oct 17 04:01:16.549478 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant: tempest-AttachVolumeShelveTestJSON-83438865 Oct 17 04:01:16.549478 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant-Id: 2301e8558e0148a481982b776c91e839 Oct 17 04:01:16.549478 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-83438865 Oct 17 04:01:16.549478 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User: tempest-AttachVolumeShelveTestJSON-83438865-project Oct 17 04:01:16.549478 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Domain-Id: default Oct 17 04:01:16.549478 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Domain-Name: Default Oct 17 04:01:16.549478 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Id: 67fe62eeb9d043a59baa93def8d43265 Oct 17 04:01:16.549478 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Name: tempest-AttachVolumeShelveTestJSON-83438865-project Oct 17 04:01:16.549478 dv-cinder-815582-16-smb devstack@n-api.service[125871]: method: > Oct 17 04:01:16.549478 dv-cinder-815582-16-smb devstack@n-api.service[125871]: exception: Instance e5d69048-2557-4e13-92de-3381030814e6 could not be found. Oct 17 04:01:16.549478 dv-cinder-815582-16-smb devstack@n-api.service[125871]: action_args: {'id': 'e5d69048-2557-4e13-92de-3381030814e6'} Oct 17 04:01:16.550471 dv-cinder-815582-16-smb devstack@n-api.service[125871]: {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:01:16.550471 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:01:16.550471 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 04:01:16.550471 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 04:01:16.550471 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 04:01:16.550471 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 04:01:16.550471 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 04:01:16.550471 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 04:01:16.550471 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 04:01:16.550471 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 04:01:16.550471 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5d69048-2557-4e13-92de-3381030814e6 could not be found. Oct 17 04:01:16.550471 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 04:01:16.550471 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:01:16.550471 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 04:01:16.550471 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:01:16.550471 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:01:16.550471 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:01:16.550471 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:01:16.550471 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:01:16.550471 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:01:16.552013 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:01:16.552013 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 04:01:16.552013 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 04:01:16.552013 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 04:01:16.552013 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 04:01:16.552013 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 04:01:16.552013 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 04:01:16.552013 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 04:01:16.552013 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:01:16.552013 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5d69048-2557-4e13-92de-3381030814e6 could not be found. Oct 17 04:01:16.552013 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 04:01:16.552013 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:01:16.552013 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 04:01:16.552013 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:01:16.552013 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:01:16.552013 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:01:16.552013 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:01:16.552013 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:01:16.552013 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5d69048-2557-4e13-92de-3381030814e6 could not be found. Oct 17 04:01:16.552013 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 04:01:16.553626 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-3ee1b529-10b3-4f65-9ab4-689514d09fdf tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Returning 404 to user: Instance e5d69048-2557-4e13-92de-3381030814e6 could not be found. {{(pid=125871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:01:16.553626 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-3ee1b529-10b3-4f65-9ab4-689514d09fdf tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6" status: 404 len: 111 microversion: 2.20 time: 0.030839 Oct 17 04:01:16.553626 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 502/997] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Oct 17 04:01:16 2022] DELETE /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 04:01:16.554732 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-a2953627-ae51-4a72-aee7-fc44283136de tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:01:16.555403 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-a2953627-ae51-4a72-aee7-fc44283136de tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: e5d69048-2557-4e13-92de-3381030814e6] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:01:16.562618 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a2953627-ae51-4a72-aee7-fc44283136de tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:01:16.563087 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a2953627-ae51-4a72-aee7-fc44283136de tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:01:16.563628 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a2953627-ae51-4a72-aee7-fc44283136de tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:01:16.564328 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a2953627-ae51-4a72-aee7-fc44283136de tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:01:16.564874 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a2953627-ae51-4a72-aee7-fc44283136de tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:01:16.565191 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a2953627-ae51-4a72-aee7-fc44283136de tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:01:16.579831 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.wsgi [None req-a2953627-ae51-4a72-aee7-fc44283136de tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] HTTP exception thrown: Instance e5d69048-2557-4e13-92de-3381030814e6 could not be found. Oct 17 04:01:16.581728 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-a2953627-ae51-4a72-aee7-fc44283136de tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Request method failure captured: Oct 17 04:01:16.581728 dv-cinder-815582-16-smb devstack@n-api.service[125872]: request: GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6 HTTP/1.1 Oct 17 04:01:16.581728 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Accept: application/json Oct 17 04:01:16.581728 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Accept-Encoding: identity Oct 17 04:01:16.581728 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Connection: close Oct 17 04:01:16.581728 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Content-Length: 0 Oct 17 04:01:16.581728 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Content-Type: application/json Oct 17 04:01:16.581728 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Host: 10.222.0.16 Oct 17 04:01:16.581728 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Openstack-System-Scope: None Oct 17 04:01:16.581728 dv-cinder-815582-16-smb devstack@n-api.service[125872]: User-Agent: python-urllib3/1.26.12 Oct 17 04:01:16.581728 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Auth-Token: gAAAAABjTNIfzfnfmWkMHvBxR2mN22jJ3POuCUUIzn-IRWM1bgN5ZquLGdB_CZMe9aZfDERBL4l0zV3ez1mejdg2GIcxV3KbJ4y2MPhGNW4ETthpFHK__eMgAUq4xi_0AyAq2jFPQ8FnHVgFK3v8-BNe07aI9YNG65Qgj4loEcoGjf5VYTsM-0g Oct 17 04:01:16.581728 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Domain-Id: None Oct 17 04:01:16.581728 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Domain-Name: None Oct 17 04:01:16.581728 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Identity-Status: Confirmed Oct 17 04:01:16.581728 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Is-Admin-Project: True Oct 17 04:01:16.581728 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Openstack-Nova-Api-Version: 2.20 Oct 17 04:01:16.581728 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Domain-Id: default Oct 17 04:01:16.581728 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Domain-Name: Default Oct 17 04:01:16.581728 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Id: 2301e8558e0148a481982b776c91e839 Oct 17 04:01:16.581728 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-83438865 Oct 17 04:01:16.581728 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Role: reader,member Oct 17 04:01:16.581728 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Roles: reader,member Oct 17 04:01:16.583139 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2301e8558e0148a481982b776c91e839"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2301e8558e0148a481982b776c91e839"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2301e8558e0148a481982b776c91e839"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2301e8558e0148a481982b776c91e839", "adminURL": "http://10.222.0.16:8080"}]}] Oct 17 04:01:16.583139 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant: tempest-AttachVolumeShelveTestJSON-83438865 Oct 17 04:01:16.583139 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant-Id: 2301e8558e0148a481982b776c91e839 Oct 17 04:01:16.583139 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-83438865 Oct 17 04:01:16.583139 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User: tempest-AttachVolumeShelveTestJSON-83438865-project Oct 17 04:01:16.583139 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Domain-Id: default Oct 17 04:01:16.583139 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Domain-Name: Default Oct 17 04:01:16.583139 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Id: 67fe62eeb9d043a59baa93def8d43265 Oct 17 04:01:16.583139 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Name: tempest-AttachVolumeShelveTestJSON-83438865-project Oct 17 04:01:16.583139 dv-cinder-815582-16-smb devstack@n-api.service[125872]: method: > Oct 17 04:01:16.583139 dv-cinder-815582-16-smb devstack@n-api.service[125872]: exception: Instance e5d69048-2557-4e13-92de-3381030814e6 could not be found. Oct 17 04:01:16.583139 dv-cinder-815582-16-smb devstack@n-api.service[125872]: action_args: {'id': 'e5d69048-2557-4e13-92de-3381030814e6'} Oct 17 04:01:16.583996 dv-cinder-815582-16-smb devstack@n-api.service[125872]: {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:01:16.583996 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:01:16.583996 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 04:01:16.583996 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 04:01:16.583996 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 04:01:16.583996 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 04:01:16.583996 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 04:01:16.583996 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 04:01:16.583996 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 04:01:16.583996 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 04:01:16.583996 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5d69048-2557-4e13-92de-3381030814e6 could not be found. Oct 17 04:01:16.583996 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 04:01:16.583996 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:01:16.583996 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 04:01:16.583996 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:01:16.583996 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:01:16.583996 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:01:16.583996 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:01:16.583996 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:01:16.583996 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:01:16.585520 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:01:16.585520 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 04:01:16.585520 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 04:01:16.585520 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 04:01:16.585520 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 04:01:16.585520 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 04:01:16.585520 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:01:16.585520 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5d69048-2557-4e13-92de-3381030814e6 could not be found. Oct 17 04:01:16.585520 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 04:01:16.585520 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:01:16.585520 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 04:01:16.585520 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:01:16.585520 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:01:16.585520 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:01:16.585520 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:01:16.585520 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:01:16.585520 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5d69048-2557-4e13-92de-3381030814e6 could not be found. Oct 17 04:01:16.585520 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 04:01:16.587517 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-a2953627-ae51-4a72-aee7-fc44283136de tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Returning 404 to user: Instance e5d69048-2557-4e13-92de-3381030814e6 could not be found. {{(pid=125872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:01:16.587517 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-a2953627-ae51-4a72-aee7-fc44283136de tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6" status: 404 len: 111 microversion: 2.20 time: 0.032468 Oct 17 04:01:16.587517 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 496/998] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 04:01:16 2022] GET /compute/v2.1/servers/e5d69048-2557-4e13-92de-3381030814e6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 17 04:01:17.872905 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-db6f72db-0f5f-4b9d-98d4-03e8d85ce25f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:01:17.873420 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-db6f72db-0f5f-4b9d-98d4-03e8d85ce25f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:01:17.879844 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-db6f72db-0f5f-4b9d-98d4-03e8d85ce25f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:01:17.880284 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-db6f72db-0f5f-4b9d-98d4-03e8d85ce25f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:01:17.880720 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-db6f72db-0f5f-4b9d-98d4-03e8d85ce25f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:01:17.881407 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-db6f72db-0f5f-4b9d-98d4-03e8d85ce25f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:01:17.881861 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-db6f72db-0f5f-4b9d-98d4-03e8d85ce25f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:01:17.882283 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-db6f72db-0f5f-4b9d-98d4-03e8d85ce25f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:01:17.896096 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.wsgi [None req-db6f72db-0f5f-4b9d-98d4-03e8d85ce25f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] HTTP exception thrown: Instance 0982f171-946d-4314-89f2-c139e6bf9adf could not be found. Oct 17 04:01:17.897629 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-db6f72db-0f5f-4b9d-98d4-03e8d85ce25f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Request method failure captured: Oct 17 04:01:17.897629 dv-cinder-815582-16-smb devstack@n-api.service[125871]: request: DELETE /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf HTTP/1.1 Oct 17 04:01:17.897629 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Accept: application/json Oct 17 04:01:17.897629 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Accept-Encoding: identity Oct 17 04:01:17.897629 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Connection: close Oct 17 04:01:17.897629 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Content-Length: 0 Oct 17 04:01:17.897629 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Content-Type: application/json Oct 17 04:01:17.897629 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Host: 10.222.0.16 Oct 17 04:01:17.897629 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Openstack-System-Scope: None Oct 17 04:01:17.897629 dv-cinder-815582-16-smb devstack@n-api.service[125871]: User-Agent: python-urllib3/1.26.12 Oct 17 04:01:17.897629 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Auth-Token: gAAAAABjTNIfzfnfmWkMHvBxR2mN22jJ3POuCUUIzn-IRWM1bgN5ZquLGdB_CZMe9aZfDERBL4l0zV3ez1mejdg2GIcxV3KbJ4y2MPhGNW4ETthpFHK__eMgAUq4xi_0AyAq2jFPQ8FnHVgFK3v8-BNe07aI9YNG65Qgj4loEcoGjf5VYTsM-0g Oct 17 04:01:17.897629 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Domain-Id: None Oct 17 04:01:17.897629 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Domain-Name: None Oct 17 04:01:17.897629 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Identity-Status: Confirmed Oct 17 04:01:17.897629 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Is-Admin-Project: True Oct 17 04:01:17.897629 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Openstack-Nova-Api-Version: 2.20 Oct 17 04:01:17.897629 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Domain-Id: default Oct 17 04:01:17.897629 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Domain-Name: Default Oct 17 04:01:17.897629 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Id: 2301e8558e0148a481982b776c91e839 Oct 17 04:01:17.897629 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-83438865 Oct 17 04:01:17.897629 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Role: reader,member Oct 17 04:01:17.897629 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Roles: reader,member Oct 17 04:01:17.899329 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2301e8558e0148a481982b776c91e839"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2301e8558e0148a481982b776c91e839"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2301e8558e0148a481982b776c91e839"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2301e8558e0148a481982b776c91e839", "adminURL": "http://10.222.0.16:8080"}]}] Oct 17 04:01:17.899329 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant: tempest-AttachVolumeShelveTestJSON-83438865 Oct 17 04:01:17.899329 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant-Id: 2301e8558e0148a481982b776c91e839 Oct 17 04:01:17.899329 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-83438865 Oct 17 04:01:17.899329 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User: tempest-AttachVolumeShelveTestJSON-83438865-project Oct 17 04:01:17.899329 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Domain-Id: default Oct 17 04:01:17.899329 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Domain-Name: Default Oct 17 04:01:17.899329 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Id: 67fe62eeb9d043a59baa93def8d43265 Oct 17 04:01:17.899329 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Name: tempest-AttachVolumeShelveTestJSON-83438865-project Oct 17 04:01:17.899329 dv-cinder-815582-16-smb devstack@n-api.service[125871]: method: > Oct 17 04:01:17.899329 dv-cinder-815582-16-smb devstack@n-api.service[125871]: exception: Instance 0982f171-946d-4314-89f2-c139e6bf9adf could not be found. Oct 17 04:01:17.899329 dv-cinder-815582-16-smb devstack@n-api.service[125871]: action_args: {'id': '0982f171-946d-4314-89f2-c139e6bf9adf'} Oct 17 04:01:17.900136 dv-cinder-815582-16-smb devstack@n-api.service[125871]: {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:01:17.900136 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:01:17.900136 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 04:01:17.900136 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 04:01:17.900136 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 04:01:17.900136 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 04:01:17.900136 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 04:01:17.900136 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 04:01:17.900136 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 04:01:17.900136 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 04:01:17.900136 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0982f171-946d-4314-89f2-c139e6bf9adf could not be found. Oct 17 04:01:17.900136 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 04:01:17.900136 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:01:17.900136 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 04:01:17.900136 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:01:17.900136 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:01:17.900136 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:01:17.900136 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:01:17.900136 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:01:17.900136 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:01:17.902032 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:01:17.902032 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 04:01:17.902032 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 04:01:17.902032 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 04:01:17.902032 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 04:01:17.902032 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 04:01:17.902032 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 04:01:17.902032 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 04:01:17.902032 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:01:17.902032 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0982f171-946d-4314-89f2-c139e6bf9adf could not be found. Oct 17 04:01:17.902032 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 04:01:17.902032 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:01:17.902032 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 04:01:17.902032 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:01:17.902032 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:01:17.902032 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:01:17.902032 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:01:17.902032 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:01:17.902032 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0982f171-946d-4314-89f2-c139e6bf9adf could not be found. Oct 17 04:01:17.902032 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 04:01:17.903303 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-db6f72db-0f5f-4b9d-98d4-03e8d85ce25f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Returning 404 to user: Instance 0982f171-946d-4314-89f2-c139e6bf9adf could not be found. {{(pid=125871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:01:17.903303 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-db6f72db-0f5f-4b9d-98d4-03e8d85ce25f tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 404 len: 111 microversion: 2.20 time: 0.030090 Oct 17 04:01:17.903303 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 503/999] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Oct 17 04:01:17 2022] DELETE /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 04:01:17.908695 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-d09aee1d-9be9-40eb-ad1a-a9496495e3b8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:01:17.909360 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-d09aee1d-9be9-40eb-ad1a-a9496495e3b8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] [instance: 0982f171-946d-4314-89f2-c139e6bf9adf] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:01:17.916147 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d09aee1d-9be9-40eb-ad1a-a9496495e3b8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:01:17.916649 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d09aee1d-9be9-40eb-ad1a-a9496495e3b8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:01:17.917085 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d09aee1d-9be9-40eb-ad1a-a9496495e3b8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:01:17.917788 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d09aee1d-9be9-40eb-ad1a-a9496495e3b8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:01:17.918245 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d09aee1d-9be9-40eb-ad1a-a9496495e3b8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:01:17.918668 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d09aee1d-9be9-40eb-ad1a-a9496495e3b8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:01:17.931970 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.wsgi [None req-d09aee1d-9be9-40eb-ad1a-a9496495e3b8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] HTTP exception thrown: Instance 0982f171-946d-4314-89f2-c139e6bf9adf could not be found. Oct 17 04:01:17.933501 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-d09aee1d-9be9-40eb-ad1a-a9496495e3b8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Request method failure captured: Oct 17 04:01:17.933501 dv-cinder-815582-16-smb devstack@n-api.service[125872]: request: GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf HTTP/1.1 Oct 17 04:01:17.933501 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Accept: application/json Oct 17 04:01:17.933501 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Accept-Encoding: identity Oct 17 04:01:17.933501 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Connection: close Oct 17 04:01:17.933501 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Content-Length: 0 Oct 17 04:01:17.933501 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Content-Type: application/json Oct 17 04:01:17.933501 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Host: 10.222.0.16 Oct 17 04:01:17.933501 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Openstack-System-Scope: None Oct 17 04:01:17.933501 dv-cinder-815582-16-smb devstack@n-api.service[125872]: User-Agent: python-urllib3/1.26.12 Oct 17 04:01:17.933501 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Auth-Token: gAAAAABjTNIfzfnfmWkMHvBxR2mN22jJ3POuCUUIzn-IRWM1bgN5ZquLGdB_CZMe9aZfDERBL4l0zV3ez1mejdg2GIcxV3KbJ4y2MPhGNW4ETthpFHK__eMgAUq4xi_0AyAq2jFPQ8FnHVgFK3v8-BNe07aI9YNG65Qgj4loEcoGjf5VYTsM-0g Oct 17 04:01:17.933501 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Domain-Id: None Oct 17 04:01:17.933501 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Domain-Name: None Oct 17 04:01:17.933501 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Identity-Status: Confirmed Oct 17 04:01:17.933501 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Is-Admin-Project: True Oct 17 04:01:17.933501 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Openstack-Nova-Api-Version: 2.20 Oct 17 04:01:17.933501 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Domain-Id: default Oct 17 04:01:17.933501 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Domain-Name: Default Oct 17 04:01:17.933501 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Id: 2301e8558e0148a481982b776c91e839 Oct 17 04:01:17.933501 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-83438865 Oct 17 04:01:17.933501 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Role: reader,member Oct 17 04:01:17.933501 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Roles: reader,member Oct 17 04:01:17.935331 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2301e8558e0148a481982b776c91e839"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2301e8558e0148a481982b776c91e839"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2301e8558e0148a481982b776c91e839"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2301e8558e0148a481982b776c91e839", "adminURL": "http://10.222.0.16:8080"}]}] Oct 17 04:01:17.935331 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant: tempest-AttachVolumeShelveTestJSON-83438865 Oct 17 04:01:17.935331 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant-Id: 2301e8558e0148a481982b776c91e839 Oct 17 04:01:17.935331 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-83438865 Oct 17 04:01:17.935331 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User: tempest-AttachVolumeShelveTestJSON-83438865-project Oct 17 04:01:17.935331 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Domain-Id: default Oct 17 04:01:17.935331 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Domain-Name: Default Oct 17 04:01:17.935331 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Id: 67fe62eeb9d043a59baa93def8d43265 Oct 17 04:01:17.935331 dv-cinder-815582-16-smb devstack@n-api.service[125872]: X-User-Name: tempest-AttachVolumeShelveTestJSON-83438865-project Oct 17 04:01:17.935331 dv-cinder-815582-16-smb devstack@n-api.service[125872]: method: > Oct 17 04:01:17.935331 dv-cinder-815582-16-smb devstack@n-api.service[125872]: exception: Instance 0982f171-946d-4314-89f2-c139e6bf9adf could not be found. Oct 17 04:01:17.935331 dv-cinder-815582-16-smb devstack@n-api.service[125872]: action_args: {'id': '0982f171-946d-4314-89f2-c139e6bf9adf'} Oct 17 04:01:17.936262 dv-cinder-815582-16-smb devstack@n-api.service[125872]: {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:01:17.936262 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:01:17.936262 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 04:01:17.936262 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 04:01:17.936262 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 04:01:17.936262 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 04:01:17.936262 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 04:01:17.936262 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 04:01:17.936262 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 04:01:17.936262 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 04:01:17.936262 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0982f171-946d-4314-89f2-c139e6bf9adf could not be found. Oct 17 04:01:17.936262 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 04:01:17.936262 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:01:17.936262 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 04:01:17.936262 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:01:17.936262 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:01:17.936262 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:01:17.936262 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:01:17.936262 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:01:17.936262 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:01:17.937778 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:01:17.937778 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 04:01:17.937778 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 04:01:17.937778 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 04:01:17.937778 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 04:01:17.937778 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 04:01:17.937778 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:01:17.937778 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0982f171-946d-4314-89f2-c139e6bf9adf could not be found. Oct 17 04:01:17.937778 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 04:01:17.937778 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:01:17.937778 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 04:01:17.937778 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:01:17.937778 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:01:17.937778 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:01:17.937778 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:01:17.937778 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:01:17.937778 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0982f171-946d-4314-89f2-c139e6bf9adf could not be found. Oct 17 04:01:17.937778 dv-cinder-815582-16-smb devstack@n-api.service[125872]: ERROR nova.api.openstack.wsgi Oct 17 04:01:17.939549 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-d09aee1d-9be9-40eb-ad1a-a9496495e3b8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] Returning 404 to user: Instance 0982f171-946d-4314-89f2-c139e6bf9adf could not be found. {{(pid=125872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:01:17.939549 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-d09aee1d-9be9-40eb-ad1a-a9496495e3b8 tempest-AttachVolumeShelveTestJSON-83438865 tempest-AttachVolumeShelveTestJSON-83438865-project] 10.222.0.16 "GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf" status: 404 len: 111 microversion: 2.20 time: 0.030466 Oct 17 04:01:17.939549 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 497/1000] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 04:01:17 2022] GET /compute/v2.1/servers/0982f171-946d-4314-89f2-c139e6bf9adf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 17 04:03:00.584892 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR oslo.messaging._drivers.impl_rabbit [-] [883fc434-4ef6-4d70-898c-c7133dea97ed] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 17 04:03:00.588383 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_api:SELECT=12 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:03:00.588383 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_cell1:SELECT=20 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:03:00.588383 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 04:03:00.588383 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Mon Oct 17 04:03:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.16) !!! Oct 17 04:03:00.588910 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 04:03:00.589033 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Mon Oct 17 04:03:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.16) !!! Oct 17 04:03:00.593330 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-43988642-b27d-432d-ba74-e8ce2f8f86b4 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Action: 'create', calling method: .version_select at 0x7fd72a577700>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1107637625", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZacI7UuJBVxX1h+wqAeuuCPvVX5XkbAa5qQPQKsVGwzq47BAu+WG5dzqWjSt3ZKxo5TBZ7ilQAinp3JMFJvFdDoe9ofNnnWHmD1GRxViVSlpLMlsczq6vfpE4+x1lGyQ=="}} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:03:00.613326 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.quota [None req-43988642-b27d-432d-ba74-e8ce2f8f86b4 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Getting quotas for project d50595c86d254a0a95712a0e3ded486a. Resources: {'key_pairs'} {{(pid=125871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 04:03:00.617150 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.quota [None req-43988642-b27d-432d-ba74-e8ce2f8f86b4 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Getting quotas for user 49cda221e54e4950b080b9b4235bac39 and project d50595c86d254a0a95712a0e3ded486a. Resources: {'key_pairs'} {{(pid=125871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 04:03:00.711426 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-43988642-b27d-432d-ba74-e8ce2f8f86b4 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.128501 Oct 17 04:03:00.712037 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 504/1001] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 17 04:03:00 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:03:00.759988 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:03:00.761263 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:03:00.762748 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 17 04:03:00.767886 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-757bbf49-2061-4c02-9dc5-4f751d6756a7 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-903386663", "imageRef": "c1779b9f-de79-4c60-829d-e3bfb558890e", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1107637625", "networks": [{"uuid": "addb45cd-328d-47ef-8304-29a46ef165e8"}]}} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:03:00.819923 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.network.neutron [None req-757bbf49-2061-4c02-9dc5-4f751d6756a7 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] validate_networks() for [('addb45cd-328d-47ef-8304-29a46ef165e8', None, None, None, None, None)] {{(pid=125872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 04:03:01.177301 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.virt.hardware [None req-757bbf49-2061-4c02-9dc5-4f751d6756a7 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Flavor limits 0:0:0 {{(pid=125872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 04:03:01.177725 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.virt.hardware [None req-757bbf49-2061-4c02-9dc5-4f751d6756a7 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Image limits 0:0:0 {{(pid=125872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 04:03:01.178224 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.virt.hardware [None req-757bbf49-2061-4c02-9dc5-4f751d6756a7 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Flavor pref 0:0:0 {{(pid=125872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 04:03:01.178630 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.virt.hardware [None req-757bbf49-2061-4c02-9dc5-4f751d6756a7 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Image pref 0:0:0 {{(pid=125872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 04:03:01.179037 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.virt.hardware [None req-757bbf49-2061-4c02-9dc5-4f751d6756a7 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 04:03:01.188296 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-757bbf49-2061-4c02-9dc5-4f751d6756a7 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:03:01.188771 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-757bbf49-2061-4c02-9dc5-4f751d6756a7 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:03:01.189202 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-757bbf49-2061-4c02-9dc5-4f751d6756a7 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:03:01.189927 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-757bbf49-2061-4c02-9dc5-4f751d6756a7 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:03:01.190380 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-757bbf49-2061-4c02-9dc5-4f751d6756a7 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:03:01.190799 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-757bbf49-2061-4c02-9dc5-4f751d6756a7 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:03:01.207051 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.quota [None req-757bbf49-2061-4c02-9dc5-4f751d6756a7 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Getting quotas for project d50595c86d254a0a95712a0e3ded486a. Resources: {'cores', 'instances', 'ram'} {{(pid=125872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 04:03:01.211259 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.quota [None req-757bbf49-2061-4c02-9dc5-4f751d6756a7 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Getting quotas for user 49cda221e54e4950b080b9b4235bac39 and project d50595c86d254a0a95712a0e3ded486a. Resources: {'cores', 'instances', 'ram'} {{(pid=125872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 04:03:01.222888 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-757bbf49-2061-4c02-9dc5-4f751d6756a7 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Going to run 1 instances... {{(pid=125872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 04:03:01.225138 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-757bbf49-2061-4c02-9dc5-4f751d6756a7 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] [instance: 10c3063b-9969-488b-beff-64bf6f6a87ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c1779b9f-de79-4c60-829d-e3bfb558890e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 04:03:01.353165 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-757bbf49-2061-4c02-9dc5-4f751d6756a7 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.594959 Oct 17 04:03:01.353824 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 498/1002] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 17 04:03:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 04:03:01.365541 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-f563a09c-6ebb-49b1-809c-ffd2e6c14ab7 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:03:01.366221 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-f563a09c-6ebb-49b1-809c-ffd2e6c14ab7 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] [instance: 10c3063b-9969-488b-beff-64bf6f6a87ba] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:03:01.420149 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-f563a09c-6ebb-49b1-809c-ffd2e6c14ab7 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49cda221e54e4950b080b9b4235bac39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50595c86d254a0a95712a0e3ded486a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:03:01.426961 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-f563a09c-6ebb-49b1-809c-ffd2e6c14ab7 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] 10.222.0.16 "GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba" status: 200 len: 1258 microversion: 2.1 time: 0.065509 Oct 17 04:03:01.427525 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 505/1003] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 04:03:01 2022] GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba => generated 1258 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:03:02.449817 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-1844250b-6432-41af-88f7-71ef3f49d024 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:03:02.450431 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-1844250b-6432-41af-88f7-71ef3f49d024 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] [instance: 10c3063b-9969-488b-beff-64bf6f6a87ba] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:03:02.457899 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1844250b-6432-41af-88f7-71ef3f49d024 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:03:02.458387 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1844250b-6432-41af-88f7-71ef3f49d024 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:03:02.458820 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1844250b-6432-41af-88f7-71ef3f49d024 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:03:02.459554 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1844250b-6432-41af-88f7-71ef3f49d024 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:03:02.460008 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1844250b-6432-41af-88f7-71ef3f49d024 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:03:02.460430 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1844250b-6432-41af-88f7-71ef3f49d024 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:03:02.523271 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-1844250b-6432-41af-88f7-71ef3f49d024 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49cda221e54e4950b080b9b4235bac39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50595c86d254a0a95712a0e3ded486a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:03:02.531468 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-1844250b-6432-41af-88f7-71ef3f49d024 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] 10.222.0.16 "GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba" status: 200 len: 1262 microversion: 2.1 time: 0.085529 Oct 17 04:03:02.532033 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 499/1004] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 04:03:02 2022] GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba => generated 1262 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:03:03.554213 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-265381a3-b4c5-4d70-96df-7f64af8ca121 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:03:03.554830 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-265381a3-b4c5-4d70-96df-7f64af8ca121 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] [instance: 10c3063b-9969-488b-beff-64bf6f6a87ba] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:03:03.562061 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-265381a3-b4c5-4d70-96df-7f64af8ca121 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:03:03.562547 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-265381a3-b4c5-4d70-96df-7f64af8ca121 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:03:03.562979 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-265381a3-b4c5-4d70-96df-7f64af8ca121 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:03:03.563709 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-265381a3-b4c5-4d70-96df-7f64af8ca121 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:03:03.564171 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-265381a3-b4c5-4d70-96df-7f64af8ca121 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:03:03.564598 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-265381a3-b4c5-4d70-96df-7f64af8ca121 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:03:03.572524 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO oslo.messaging._drivers.impl_rabbit [-] [883fc434-4ef6-4d70-898c-c7133dea97ed] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 36088. Oct 17 04:03:03.628385 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-265381a3-b4c5-4d70-96df-7f64af8ca121 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49cda221e54e4950b080b9b4235bac39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50595c86d254a0a95712a0e3ded486a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:03:03.636792 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-265381a3-b4c5-4d70-96df-7f64af8ca121 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] 10.222.0.16 "GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba" status: 200 len: 1318 microversion: 2.1 time: 0.086736 Oct 17 04:03:03.637366 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 506/1005] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 04:03:03 2022] GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba => generated 1318 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:03:04.665945 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-2ffd3e5e-3d21-4b94-8adb-75ea81bb8870 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:03:04.667305 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-2ffd3e5e-3d21-4b94-8adb-75ea81bb8870 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] [instance: 10c3063b-9969-488b-beff-64bf6f6a87ba] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:03:04.674481 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2ffd3e5e-3d21-4b94-8adb-75ea81bb8870 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:03:04.675193 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2ffd3e5e-3d21-4b94-8adb-75ea81bb8870 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:03:04.675803 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2ffd3e5e-3d21-4b94-8adb-75ea81bb8870 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:03:04.676666 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2ffd3e5e-3d21-4b94-8adb-75ea81bb8870 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:03:04.677502 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2ffd3e5e-3d21-4b94-8adb-75ea81bb8870 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:03:04.678090 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-2ffd3e5e-3d21-4b94-8adb-75ea81bb8870 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:03:04.832620 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-2ffd3e5e-3d21-4b94-8adb-75ea81bb8870 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49cda221e54e4950b080b9b4235bac39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50595c86d254a0a95712a0e3ded486a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:03:04.840824 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-2ffd3e5e-3d21-4b94-8adb-75ea81bb8870 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] 10.222.0.16 "GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba" status: 200 len: 1358 microversion: 2.1 time: 0.179103 Oct 17 04:03:04.841396 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 500/1006] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 04:03:04 2022] GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:03:05.866076 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-a5a1338e-d267-4893-b389-b3e9a47dd86e tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:03:05.866737 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-a5a1338e-d267-4893-b389-b3e9a47dd86e tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] [instance: 10c3063b-9969-488b-beff-64bf6f6a87ba] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:03:05.873885 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a5a1338e-d267-4893-b389-b3e9a47dd86e tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:03:05.874403 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a5a1338e-d267-4893-b389-b3e9a47dd86e tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:03:05.874840 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a5a1338e-d267-4893-b389-b3e9a47dd86e tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:03:05.875560 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a5a1338e-d267-4893-b389-b3e9a47dd86e tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:03:05.876014 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a5a1338e-d267-4893-b389-b3e9a47dd86e tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:03:05.876436 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-a5a1338e-d267-4893-b389-b3e9a47dd86e tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:03:06.021578 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-a5a1338e-d267-4893-b389-b3e9a47dd86e tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49cda221e54e4950b080b9b4235bac39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50595c86d254a0a95712a0e3ded486a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:03:06.021578 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-a5a1338e-d267-4893-b389-b3e9a47dd86e tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] 10.222.0.16 "GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba" status: 200 len: 1358 microversion: 2.1 time: 0.156160 Oct 17 04:03:06.021578 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 507/1007] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 04:03:05 2022] GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:03:07.041640 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-34d90188-d41d-4e9f-aa6b-a6f95bc30ab3 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:03:07.043361 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-34d90188-d41d-4e9f-aa6b-a6f95bc30ab3 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] [instance: 10c3063b-9969-488b-beff-64bf6f6a87ba] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:03:07.051459 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-34d90188-d41d-4e9f-aa6b-a6f95bc30ab3 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:03:07.052441 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-34d90188-d41d-4e9f-aa6b-a6f95bc30ab3 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:03:07.053429 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-34d90188-d41d-4e9f-aa6b-a6f95bc30ab3 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:03:07.054989 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-34d90188-d41d-4e9f-aa6b-a6f95bc30ab3 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:03:07.055602 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-34d90188-d41d-4e9f-aa6b-a6f95bc30ab3 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:03:07.056125 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-34d90188-d41d-4e9f-aa6b-a6f95bc30ab3 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:03:07.191598 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-34d90188-d41d-4e9f-aa6b-a6f95bc30ab3 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49cda221e54e4950b080b9b4235bac39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50595c86d254a0a95712a0e3ded486a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:03:07.200342 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-34d90188-d41d-4e9f-aa6b-a6f95bc30ab3 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] 10.222.0.16 "GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba" status: 200 len: 1358 microversion: 2.1 time: 0.162985 Oct 17 04:03:07.207325 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 501/1008] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 04:03:07 2022] GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:03:08.224664 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-0515ff6a-c1ff-43c3-9a4b-4b79cc1d9448 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:03:08.225273 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-0515ff6a-c1ff-43c3-9a4b-4b79cc1d9448 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] [instance: 10c3063b-9969-488b-beff-64bf6f6a87ba] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:03:08.232241 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0515ff6a-c1ff-43c3-9a4b-4b79cc1d9448 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:03:08.232799 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0515ff6a-c1ff-43c3-9a4b-4b79cc1d9448 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:03:08.233511 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0515ff6a-c1ff-43c3-9a4b-4b79cc1d9448 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:03:08.234466 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0515ff6a-c1ff-43c3-9a4b-4b79cc1d9448 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:03:08.234989 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0515ff6a-c1ff-43c3-9a4b-4b79cc1d9448 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:03:08.235545 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-0515ff6a-c1ff-43c3-9a4b-4b79cc1d9448 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:03:08.371231 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-0515ff6a-c1ff-43c3-9a4b-4b79cc1d9448 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49cda221e54e4950b080b9b4235bac39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50595c86d254a0a95712a0e3ded486a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:03:08.406506 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-0515ff6a-c1ff-43c3-9a4b-4b79cc1d9448 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] 10.222.0.16 "GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba" status: 200 len: 1358 microversion: 2.1 time: 0.186555 Oct 17 04:03:08.407464 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 508/1009] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 04:03:08 2022] GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:03:09.429878 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-90712520-c2eb-4f55-a11f-5094177bf03a tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:03:09.430420 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-90712520-c2eb-4f55-a11f-5094177bf03a tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] [instance: 10c3063b-9969-488b-beff-64bf6f6a87ba] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:03:09.437132 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-90712520-c2eb-4f55-a11f-5094177bf03a tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:03:09.437618 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-90712520-c2eb-4f55-a11f-5094177bf03a tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:03:09.438054 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-90712520-c2eb-4f55-a11f-5094177bf03a tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:03:09.438747 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-90712520-c2eb-4f55-a11f-5094177bf03a tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:03:09.439237 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-90712520-c2eb-4f55-a11f-5094177bf03a tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:03:09.439665 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-90712520-c2eb-4f55-a11f-5094177bf03a tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:03:09.592161 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-90712520-c2eb-4f55-a11f-5094177bf03a tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49cda221e54e4950b080b9b4235bac39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50595c86d254a0a95712a0e3ded486a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:03:09.601259 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-90712520-c2eb-4f55-a11f-5094177bf03a tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] 10.222.0.16 "GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba" status: 200 len: 1358 microversion: 2.1 time: 0.175242 Oct 17 04:03:09.601971 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 502/1010] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 04:03:09 2022] GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:03:10.624457 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-e61abccf-df4d-4918-a3cd-9e21ac5eda2a tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:03:10.625159 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-e61abccf-df4d-4918-a3cd-9e21ac5eda2a tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] [instance: 10c3063b-9969-488b-beff-64bf6f6a87ba] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:03:10.631893 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e61abccf-df4d-4918-a3cd-9e21ac5eda2a tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:03:10.632670 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e61abccf-df4d-4918-a3cd-9e21ac5eda2a tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:03:10.633267 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e61abccf-df4d-4918-a3cd-9e21ac5eda2a tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:03:10.634033 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e61abccf-df4d-4918-a3cd-9e21ac5eda2a tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:03:10.634568 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e61abccf-df4d-4918-a3cd-9e21ac5eda2a tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:03:10.634999 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-e61abccf-df4d-4918-a3cd-9e21ac5eda2a tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:03:10.815374 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-e61abccf-df4d-4918-a3cd-9e21ac5eda2a tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49cda221e54e4950b080b9b4235bac39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50595c86d254a0a95712a0e3ded486a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:03:10.824585 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-e61abccf-df4d-4918-a3cd-9e21ac5eda2a tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] 10.222.0.16 "GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba" status: 200 len: 1358 microversion: 2.1 time: 0.203871 Oct 17 04:03:10.825609 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 509/1011] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 04:03:10 2022] GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba => generated 1358 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:03:11.849827 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-76377953-1b81-4995-b3ee-da6e283f0d58 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:03:11.850438 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-76377953-1b81-4995-b3ee-da6e283f0d58 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] [instance: 10c3063b-9969-488b-beff-64bf6f6a87ba] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:03:11.852808 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_cell0:SELECT=2 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:03:11.853608 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_cell0:SELECT=6 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:03:11.858692 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-76377953-1b81-4995-b3ee-da6e283f0d58 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:03:11.859193 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-76377953-1b81-4995-b3ee-da6e283f0d58 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:03:11.859640 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-76377953-1b81-4995-b3ee-da6e283f0d58 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:03:11.860335 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-76377953-1b81-4995-b3ee-da6e283f0d58 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:03:11.860853 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-76377953-1b81-4995-b3ee-da6e283f0d58 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:03:11.861216 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-76377953-1b81-4995-b3ee-da6e283f0d58 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:03:12.061947 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-76377953-1b81-4995-b3ee-da6e283f0d58 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49cda221e54e4950b080b9b4235bac39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50595c86d254a0a95712a0e3ded486a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:03:12.067673 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-76377953-1b81-4995-b3ee-da6e283f0d58 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] 10.222.0.16 "GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba" status: 200 len: 1358 microversion: 2.1 time: 0.221730 Oct 17 04:03:12.068246 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 503/1012] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 04:03:11 2022] GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba => generated 1358 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:03:12.517517 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_cell0:SELECT=6 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:03:12.523614 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [req-6e2e35a3-3181-4486-8104-5381c331136d req-ac6bd109-ee3e-415f-8c5b-e388dbf05ec5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10c3063b-9969-488b-beff-64bf6f6a87ba", "tag": "610c24b4-0b64-4a74-834c-db4774ff0d87"}]} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:03:12.538013 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-6e2e35a3-3181-4486-8104-5381c331136d req-ac6bd109-ee3e-415f-8c5b-e388dbf05ec5 service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:03:12.538423 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-6e2e35a3-3181-4486-8104-5381c331136d req-ac6bd109-ee3e-415f-8c5b-e388dbf05ec5 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:03:12.538855 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-6e2e35a3-3181-4486-8104-5381c331136d req-ac6bd109-ee3e-415f-8c5b-e388dbf05ec5 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:03:12.550088 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.compute.server_external_events [req-6e2e35a3-3181-4486-8104-5381c331136d req-ac6bd109-ee3e-415f-8c5b-e388dbf05ec5 service nova] Creating event network-changed:610c24b4-0b64-4a74-834c-db4774ff0d87 for instance 10c3063b-9969-488b-beff-64bf6f6a87ba on hv-cinder-81558 Oct 17 04:03:12.555334 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [req-6e2e35a3-3181-4486-8104-5381c331136d req-ac6bd109-ee3e-415f-8c5b-e388dbf05ec5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038456 Oct 17 04:03:12.556649 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 510/1013] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 04:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:03:13.090778 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-527a08ba-478f-4beb-8892-eb8907512638 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:03:13.095819 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-527a08ba-478f-4beb-8892-eb8907512638 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] [instance: 10c3063b-9969-488b-beff-64bf6f6a87ba] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:03:13.098100 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-527a08ba-478f-4beb-8892-eb8907512638 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:03:13.098596 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-527a08ba-478f-4beb-8892-eb8907512638 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:03:13.099032 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-527a08ba-478f-4beb-8892-eb8907512638 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:03:13.099772 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-527a08ba-478f-4beb-8892-eb8907512638 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:03:13.100222 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-527a08ba-478f-4beb-8892-eb8907512638 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:03:13.100650 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-527a08ba-478f-4beb-8892-eb8907512638 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:03:13.325139 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-527a08ba-478f-4beb-8892-eb8907512638 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49cda221e54e4950b080b9b4235bac39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50595c86d254a0a95712a0e3ded486a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:03:13.332781 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-527a08ba-478f-4beb-8892-eb8907512638 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] 10.222.0.16 "GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba" status: 200 len: 1358 microversion: 2.1 time: 0.246018 Oct 17 04:03:13.333356 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 504/1014] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 04:03:13 2022] GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba => generated 1358 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:03:14.356478 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-d9e08532-7c95-42ff-9a1c-816f9271d3ef tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:03:14.357190 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-d9e08532-7c95-42ff-9a1c-816f9271d3ef tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] [instance: 10c3063b-9969-488b-beff-64bf6f6a87ba] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:03:14.363766 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d9e08532-7c95-42ff-9a1c-816f9271d3ef tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:03:14.364257 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d9e08532-7c95-42ff-9a1c-816f9271d3ef tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:03:14.364702 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d9e08532-7c95-42ff-9a1c-816f9271d3ef tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:03:14.365395 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d9e08532-7c95-42ff-9a1c-816f9271d3ef tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:03:14.365851 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d9e08532-7c95-42ff-9a1c-816f9271d3ef tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:03:14.366280 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-d9e08532-7c95-42ff-9a1c-816f9271d3ef tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:03:14.493536 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-d9e08532-7c95-42ff-9a1c-816f9271d3ef tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49cda221e54e4950b080b9b4235bac39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50595c86d254a0a95712a0e3ded486a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:03:14.501554 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-d9e08532-7c95-42ff-9a1c-816f9271d3ef tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] 10.222.0.16 "GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba" status: 200 len: 1358 microversion: 2.1 time: 0.149812 Oct 17 04:03:14.502142 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 511/1015] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 04:03:14 2022] GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:03:15.524152 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-1473b3c8-41ae-4f83-a618-2ddbec155932 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:03:15.524770 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-1473b3c8-41ae-4f83-a618-2ddbec155932 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] [instance: 10c3063b-9969-488b-beff-64bf6f6a87ba] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:03:15.530698 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1473b3c8-41ae-4f83-a618-2ddbec155932 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:03:15.531194 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1473b3c8-41ae-4f83-a618-2ddbec155932 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:03:15.531647 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1473b3c8-41ae-4f83-a618-2ddbec155932 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:03:15.532343 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1473b3c8-41ae-4f83-a618-2ddbec155932 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:03:15.532798 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1473b3c8-41ae-4f83-a618-2ddbec155932 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:03:15.533219 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1473b3c8-41ae-4f83-a618-2ddbec155932 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:03:15.664474 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-1473b3c8-41ae-4f83-a618-2ddbec155932 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49cda221e54e4950b080b9b4235bac39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50595c86d254a0a95712a0e3ded486a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:03:15.672586 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-1473b3c8-41ae-4f83-a618-2ddbec155932 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] 10.222.0.16 "GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba" status: 200 len: 1358 microversion: 2.1 time: 0.152726 Oct 17 04:03:15.676660 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 505/1016] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 04:03:15 2022] GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:03:16.695907 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-9245265e-6c71-43a3-83e4-22ac4361391a tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:03:16.696527 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-9245265e-6c71-43a3-83e4-22ac4361391a tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] [instance: 10c3063b-9969-488b-beff-64bf6f6a87ba] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:03:16.703958 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-9245265e-6c71-43a3-83e4-22ac4361391a tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:03:16.704451 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-9245265e-6c71-43a3-83e4-22ac4361391a tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:03:16.704888 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-9245265e-6c71-43a3-83e4-22ac4361391a tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:03:16.705591 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-9245265e-6c71-43a3-83e4-22ac4361391a tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:03:16.706045 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-9245265e-6c71-43a3-83e4-22ac4361391a tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:03:16.706471 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-9245265e-6c71-43a3-83e4-22ac4361391a tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:03:16.833603 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-9245265e-6c71-43a3-83e4-22ac4361391a tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49cda221e54e4950b080b9b4235bac39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50595c86d254a0a95712a0e3ded486a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:03:16.841370 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-9245265e-6c71-43a3-83e4-22ac4361391a tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] 10.222.0.16 "GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba" status: 200 len: 1358 microversion: 2.1 time: 0.149278 Oct 17 04:03:16.843287 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 512/1017] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 04:03:16 2022] GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:03:16.940058 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [req-9f81a660-b9f2-4a0b-8d30-79610b44895a req-a7fc438e-ed86-4881-9a03-60b7c526c2ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10c3063b-9969-488b-beff-64bf6f6a87ba", "name": "network-vif-plugged", "status": "completed", "tag": "610c24b4-0b64-4a74-834c-db4774ff0d87"}]} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:03:16.952654 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-9f81a660-b9f2-4a0b-8d30-79610b44895a req-a7fc438e-ed86-4881-9a03-60b7c526c2ac service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:03:16.952654 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-9f81a660-b9f2-4a0b-8d30-79610b44895a req-a7fc438e-ed86-4881-9a03-60b7c526c2ac service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:03:16.952654 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-9f81a660-b9f2-4a0b-8d30-79610b44895a req-a7fc438e-ed86-4881-9a03-60b7c526c2ac service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:03:16.961524 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.compute.server_external_events [req-9f81a660-b9f2-4a0b-8d30-79610b44895a req-a7fc438e-ed86-4881-9a03-60b7c526c2ac service nova] Creating event network-vif-plugged:610c24b4-0b64-4a74-834c-db4774ff0d87 for instance 10c3063b-9969-488b-beff-64bf6f6a87ba on hv-cinder-81558 Oct 17 04:03:16.966544 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [req-9f81a660-b9f2-4a0b-8d30-79610b44895a req-a7fc438e-ed86-4881-9a03-60b7c526c2ac service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030109 Oct 17 04:03:16.967118 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 506/1018] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 04:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:03:17.863682 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-2f655c3a-6775-44e5-85ff-01108f332bb6 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:03:17.864294 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-2f655c3a-6775-44e5-85ff-01108f332bb6 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] [instance: 10c3063b-9969-488b-beff-64bf6f6a87ba] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:03:17.870726 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2f655c3a-6775-44e5-85ff-01108f332bb6 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:03:17.871259 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2f655c3a-6775-44e5-85ff-01108f332bb6 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:03:17.871722 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2f655c3a-6775-44e5-85ff-01108f332bb6 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:03:17.872421 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2f655c3a-6775-44e5-85ff-01108f332bb6 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:03:17.872880 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2f655c3a-6775-44e5-85ff-01108f332bb6 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:03:17.873330 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2f655c3a-6775-44e5-85ff-01108f332bb6 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:03:18.259304 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-2f655c3a-6775-44e5-85ff-01108f332bb6 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49cda221e54e4950b080b9b4235bac39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50595c86d254a0a95712a0e3ded486a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:03:18.267684 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-2f655c3a-6775-44e5-85ff-01108f332bb6 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] 10.222.0.16 "GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba" status: 200 len: 1358 microversion: 2.1 time: 0.407935 Oct 17 04:03:18.268249 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 513/1019] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 04:03:17 2022] GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba => generated 1358 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:03:19.290820 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-045b0bf8-c4a5-4a8f-8eb4-540d6e09d5e3 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:03:19.291554 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-045b0bf8-c4a5-4a8f-8eb4-540d6e09d5e3 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] [instance: 10c3063b-9969-488b-beff-64bf6f6a87ba] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:03:19.297621 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-045b0bf8-c4a5-4a8f-8eb4-540d6e09d5e3 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:03:19.298094 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-045b0bf8-c4a5-4a8f-8eb4-540d6e09d5e3 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:03:19.298522 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-045b0bf8-c4a5-4a8f-8eb4-540d6e09d5e3 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:03:19.299229 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-045b0bf8-c4a5-4a8f-8eb4-540d6e09d5e3 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:03:19.299682 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-045b0bf8-c4a5-4a8f-8eb4-540d6e09d5e3 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:03:19.300102 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-045b0bf8-c4a5-4a8f-8eb4-540d6e09d5e3 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:03:19.428190 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-045b0bf8-c4a5-4a8f-8eb4-540d6e09d5e3 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49cda221e54e4950b080b9b4235bac39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50595c86d254a0a95712a0e3ded486a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:03:19.436023 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-045b0bf8-c4a5-4a8f-8eb4-540d6e09d5e3 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] 10.222.0.16 "GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba" status: 200 len: 1548 microversion: 2.1 time: 0.149834 Oct 17 04:03:19.436592 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 507/1020] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 04:03:19 2022] GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba => generated 1548 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:03:19.458616 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-111d926a-e5cc-482c-918c-031de7819568 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:03:19.459286 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-111d926a-e5cc-482c-918c-031de7819568 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] [instance: 10c3063b-9969-488b-beff-64bf6f6a87ba] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:03:19.466374 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-111d926a-e5cc-482c-918c-031de7819568 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:03:19.466863 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-111d926a-e5cc-482c-918c-031de7819568 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:03:19.467323 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-111d926a-e5cc-482c-918c-031de7819568 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:03:19.468017 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-111d926a-e5cc-482c-918c-031de7819568 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:03:19.468473 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-111d926a-e5cc-482c-918c-031de7819568 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:03:19.468896 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-111d926a-e5cc-482c-918c-031de7819568 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:03:19.595352 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-111d926a-e5cc-482c-918c-031de7819568 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49cda221e54e4950b080b9b4235bac39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50595c86d254a0a95712a0e3ded486a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:03:19.602975 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-111d926a-e5cc-482c-918c-031de7819568 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] 10.222.0.16 "GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba" status: 200 len: 1548 microversion: 2.1 time: 0.148191 Oct 17 04:03:19.603580 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 514/1021] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 04:03:19 2022] GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba => generated 1548 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:03:19.625207 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-c39f6070-e674-47fc-81e2-efc433df102b tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:03:19.630226 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-c39f6070-e674-47fc-81e2-efc433df102b tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '49cda221e54e4950b080b9b4235bac39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50595c86d254a0a95712a0e3ded486a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:03:19.630999 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-c39f6070-e674-47fc-81e2-efc433df102b tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Searching by: {'deleted': False, 'project_id': 'd50595c86d254a0a95712a0e3ded486a'} {{(pid=125872) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 04:03:19.638208 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c39f6070-e674-47fc-81e2-efc433df102b tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:03:19.638684 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c39f6070-e674-47fc-81e2-efc433df102b tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:03:19.639932 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c39f6070-e674-47fc-81e2-efc433df102b tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:03:19.639932 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c39f6070-e674-47fc-81e2-efc433df102b tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:03:19.640309 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c39f6070-e674-47fc-81e2-efc433df102b tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:03:19.640735 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-c39f6070-e674-47fc-81e2-efc433df102b tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:03:19.724187 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.multi_cell_list [None req-c39f6070-e674-47fc-81e2-efc433df102b tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125872) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 04:03:19.818720 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-c39f6070-e674-47fc-81e2-efc433df102b tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.197227 Oct 17 04:03:19.819235 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 508/1022] 10.222.0.16 () {58 vars in 1125 bytes} [Mon Oct 17 04:03:19 2022] GET /compute/v2.1/servers => generated 342 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:03:19.831413 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-8e5b1d6e-5b85-4da8-a0e3-2a1cd8543bea tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:03:19.832029 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-8e5b1d6e-5b85-4da8-a0e3-2a1cd8543bea tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] [instance: 10c3063b-9969-488b-beff-64bf6f6a87ba] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:03:19.837914 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8e5b1d6e-5b85-4da8-a0e3-2a1cd8543bea tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:03:19.838392 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8e5b1d6e-5b85-4da8-a0e3-2a1cd8543bea tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:03:19.838825 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8e5b1d6e-5b85-4da8-a0e3-2a1cd8543bea tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:03:19.839611 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8e5b1d6e-5b85-4da8-a0e3-2a1cd8543bea tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:03:19.840064 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8e5b1d6e-5b85-4da8-a0e3-2a1cd8543bea tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:03:19.840487 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-8e5b1d6e-5b85-4da8-a0e3-2a1cd8543bea tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:03:19.969174 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-8e5b1d6e-5b85-4da8-a0e3-2a1cd8543bea tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49cda221e54e4950b080b9b4235bac39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50595c86d254a0a95712a0e3ded486a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:03:19.976782 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-8e5b1d6e-5b85-4da8-a0e3-2a1cd8543bea tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] 10.222.0.16 "GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba" status: 200 len: 1548 microversion: 2.1 time: 0.149237 Oct 17 04:03:19.977350 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 515/1023] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 04:03:19 2022] GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba => generated 1548 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:03:22.080444 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-33f3c2b5-ec8a-4340-aa02-210a637467c5 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7e8108c2-3d0a-4f9a-8405-baf1581551a1"}} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:03:22.082754 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-33f3c2b5-ec8a-4340-aa02-210a637467c5 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] [instance: 10c3063b-9969-488b-beff-64bf6f6a87ba] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:03:22.089732 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-33f3c2b5-ec8a-4340-aa02-210a637467c5 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:03:22.090207 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-33f3c2b5-ec8a-4340-aa02-210a637467c5 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:03:22.090643 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-33f3c2b5-ec8a-4340-aa02-210a637467c5 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:03:22.091350 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-33f3c2b5-ec8a-4340-aa02-210a637467c5 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:03:22.091798 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-33f3c2b5-ec8a-4340-aa02-210a637467c5 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:03:22.092217 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-33f3c2b5-ec8a-4340-aa02-210a637467c5 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:03:22.953791 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-33f3c2b5-ec8a-4340-aa02-210a637467c5 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] 10.222.0.16 "POST /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.877080 Oct 17 04:03:22.959069 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 509/1024] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Oct 17 04:03:22 2022] POST /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba/os-volume_attachments => generated 194 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 04:03:25.245601 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-b28fccfa-d75c-4470-99d6-371cf06158bd tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:03:25.246220 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-b28fccfa-d75c-4470-99d6-371cf06158bd tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] [instance: 10c3063b-9969-488b-beff-64bf6f6a87ba] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:03:25.253241 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b28fccfa-d75c-4470-99d6-371cf06158bd tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:03:25.253728 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b28fccfa-d75c-4470-99d6-371cf06158bd tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:03:25.254169 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b28fccfa-d75c-4470-99d6-371cf06158bd tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:03:25.254859 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b28fccfa-d75c-4470-99d6-371cf06158bd tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:03:25.255356 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b28fccfa-d75c-4470-99d6-371cf06158bd tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:03:25.255786 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-b28fccfa-d75c-4470-99d6-371cf06158bd tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:03:25.378945 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-b28fccfa-d75c-4470-99d6-371cf06158bd tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49cda221e54e4950b080b9b4235bac39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50595c86d254a0a95712a0e3ded486a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:03:25.386992 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-b28fccfa-d75c-4470-99d6-371cf06158bd tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] 10.222.0.16 "GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba" status: 200 len: 1594 microversion: 2.1 time: 0.145188 Oct 17 04:03:25.387578 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 516/1025] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 04:03:25 2022] GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba => generated 1594 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:03:27.502545 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [req-82bc99f3-c3e9-4bec-9108-edf7cd5cf803 req-799483d1-cf7e-48a3-9b63-c3f8bdbd7d7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10c3063b-9969-488b-beff-64bf6f6a87ba", "tag": "610c24b4-0b64-4a74-834c-db4774ff0d87"}]} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:03:27.512520 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-82bc99f3-c3e9-4bec-9108-edf7cd5cf803 req-799483d1-cf7e-48a3-9b63-c3f8bdbd7d7b service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:03:27.513037 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-82bc99f3-c3e9-4bec-9108-edf7cd5cf803 req-799483d1-cf7e-48a3-9b63-c3f8bdbd7d7b service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:03:27.513467 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-82bc99f3-c3e9-4bec-9108-edf7cd5cf803 req-799483d1-cf7e-48a3-9b63-c3f8bdbd7d7b service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:03:27.524865 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.compute.server_external_events [req-82bc99f3-c3e9-4bec-9108-edf7cd5cf803 req-799483d1-cf7e-48a3-9b63-c3f8bdbd7d7b service nova] Creating event network-changed:610c24b4-0b64-4a74-834c-db4774ff0d87 for instance 10c3063b-9969-488b-beff-64bf6f6a87ba on hv-cinder-81558 Oct 17 04:03:27.530259 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [req-82bc99f3-c3e9-4bec-9108-edf7cd5cf803 req-799483d1-cf7e-48a3-9b63-c3f8bdbd7d7b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.187663 Oct 17 04:03:27.531128 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 510/1026] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 04:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:03:29.732003 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-95099fc9-ac14-42bc-9c1e-788b3911db8b tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1569175143"}} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:03:29.732540 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-95099fc9-ac14-42bc-9c1e-788b3911db8b tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] [instance: 10c3063b-9969-488b-beff-64bf6f6a87ba] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:03:29.739277 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-95099fc9-ac14-42bc-9c1e-788b3911db8b tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:03:29.739758 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-95099fc9-ac14-42bc-9c1e-788b3911db8b tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:03:29.740191 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-95099fc9-ac14-42bc-9c1e-788b3911db8b tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:03:29.740874 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-95099fc9-ac14-42bc-9c1e-788b3911db8b tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:03:29.741327 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-95099fc9-ac14-42bc-9c1e-788b3911db8b tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:03:29.746129 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-95099fc9-ac14-42bc-9c1e-788b3911db8b tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:03:29.867753 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.network.security_group_api [None req-95099fc9-ac14-42bc-9c1e-788b3911db8b tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Adding security group c3535a50-5a68-4e81-872e-525ed2a186a6 to port 610c24b4-0b64-4a74-834c-db4774ff0d87 Oct 17 04:03:30.218577 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-95099fc9-ac14-42bc-9c1e-788b3911db8b tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] 10.222.0.16 "POST /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba/action" status: 202 len: 0 microversion: 2.1 time: 0.491094 Oct 17 04:03:30.219204 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 517/1027] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 17 04:03:29 2022] POST /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba/action => generated 0 bytes in 493 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 04:03:30.228224 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-d711eaed-57b5-4ae0-a07a-87bfbb57d3e0 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:03:30.228936 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-d711eaed-57b5-4ae0-a07a-87bfbb57d3e0 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] [instance: 10c3063b-9969-488b-beff-64bf6f6a87ba] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:03:30.231474 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_cell0:SELECT=2 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:03:30.231734 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [req-808b1452-19f7-4c60-bf7e-1e214004747b req-595ca02c-8a55-423d-94ba-fc29385cb716 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10c3063b-9969-488b-beff-64bf6f6a87ba", "tag": "610c24b4-0b64-4a74-834c-db4774ff0d87"}]} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:03:30.241885 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-808b1452-19f7-4c60-bf7e-1e214004747b req-595ca02c-8a55-423d-94ba-fc29385cb716 service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:03:30.242505 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-808b1452-19f7-4c60-bf7e-1e214004747b req-595ca02c-8a55-423d-94ba-fc29385cb716 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:03:30.243031 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-808b1452-19f7-4c60-bf7e-1e214004747b req-595ca02c-8a55-423d-94ba-fc29385cb716 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:03:30.248423 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d711eaed-57b5-4ae0-a07a-87bfbb57d3e0 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:03:30.248926 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d711eaed-57b5-4ae0-a07a-87bfbb57d3e0 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:03:30.249385 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d711eaed-57b5-4ae0-a07a-87bfbb57d3e0 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:03:30.250102 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d711eaed-57b5-4ae0-a07a-87bfbb57d3e0 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:03:30.250561 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d711eaed-57b5-4ae0-a07a-87bfbb57d3e0 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:03:30.250997 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d711eaed-57b5-4ae0-a07a-87bfbb57d3e0 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:03:30.256942 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.compute.server_external_events [req-808b1452-19f7-4c60-bf7e-1e214004747b req-595ca02c-8a55-423d-94ba-fc29385cb716 service nova] Creating event network-changed:610c24b4-0b64-4a74-834c-db4774ff0d87 for instance 10c3063b-9969-488b-beff-64bf6f6a87ba on hv-cinder-81558 Oct 17 04:03:30.263033 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [req-808b1452-19f7-4c60-bf7e-1e214004747b req-595ca02c-8a55-423d-94ba-fc29385cb716 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035520 Oct 17 04:03:30.264258 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 518/1028] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 04:03:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:03:30.495041 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-d711eaed-57b5-4ae0-a07a-87bfbb57d3e0 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49cda221e54e4950b080b9b4235bac39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50595c86d254a0a95712a0e3ded486a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:03:30.504319 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-d711eaed-57b5-4ae0-a07a-87bfbb57d3e0 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] 10.222.0.16 "GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba" status: 200 len: 1759 microversion: 2.1 time: 0.280365 Oct 17 04:03:30.505164 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 511/1029] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 04:03:30 2022] GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba => generated 1759 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:03:52.830713 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:03:52.831471 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_cell1:SELECT=68 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:03:52.835530 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-4e5fc10a-51d7-4318-b824-6d725e9fb7bf tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:03:52.837774 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-4e5fc10a-51d7-4318-b824-6d725e9fb7bf tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] [instance: 10c3063b-9969-488b-beff-64bf6f6a87ba] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:03:52.843708 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-4e5fc10a-51d7-4318-b824-6d725e9fb7bf tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:03:52.846721 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-4e5fc10a-51d7-4318-b824-6d725e9fb7bf tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:03:52.846721 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-4e5fc10a-51d7-4318-b824-6d725e9fb7bf tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:03:52.846721 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-4e5fc10a-51d7-4318-b824-6d725e9fb7bf tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:03:52.846721 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-4e5fc10a-51d7-4318-b824-6d725e9fb7bf tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:03:52.847094 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-4e5fc10a-51d7-4318-b824-6d725e9fb7bf tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:03:53.068294 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-4e5fc10a-51d7-4318-b824-6d725e9fb7bf tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] 10.222.0.16 "POST /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba/action" status: 202 len: 0 microversion: 2.1 time: 0.239369 Oct 17 04:03:53.069552 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 519/1030] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 17 04:03:52 2022] POST /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 04:03:53.077098 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-02cb22d3-ce5d-4675-9c8c-1ec520412f93 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:03:53.077800 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-02cb22d3-ce5d-4675-9c8c-1ec520412f93 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] [instance: 10c3063b-9969-488b-beff-64bf6f6a87ba] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:03:53.080647 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:03:53.085568 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:03:53.085975 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-02cb22d3-ce5d-4675-9c8c-1ec520412f93 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:03:53.086453 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-02cb22d3-ce5d-4675-9c8c-1ec520412f93 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:03:53.086886 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-02cb22d3-ce5d-4675-9c8c-1ec520412f93 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:03:53.087598 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-02cb22d3-ce5d-4675-9c8c-1ec520412f93 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:03:53.088071 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-02cb22d3-ce5d-4675-9c8c-1ec520412f93 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:03:53.088492 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-02cb22d3-ce5d-4675-9c8c-1ec520412f93 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:03:53.351511 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-02cb22d3-ce5d-4675-9c8c-1ec520412f93 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49cda221e54e4950b080b9b4235bac39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50595c86d254a0a95712a0e3ded486a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:03:53.359589 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-02cb22d3-ce5d-4675-9c8c-1ec520412f93 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] 10.222.0.16 "GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba" status: 200 len: 1751 microversion: 2.1 time: 0.286529 Oct 17 04:03:53.360164 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 512/1031] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 04:03:53 2022] GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba => generated 1751 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:03:54.384599 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-3c560cd0-298b-4905-96e5-2e397e77ca4c tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:03:54.385293 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-3c560cd0-298b-4905-96e5-2e397e77ca4c tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] [instance: 10c3063b-9969-488b-beff-64bf6f6a87ba] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:03:54.391427 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3c560cd0-298b-4905-96e5-2e397e77ca4c tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:03:54.391954 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3c560cd0-298b-4905-96e5-2e397e77ca4c tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:03:54.392390 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3c560cd0-298b-4905-96e5-2e397e77ca4c tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:03:54.393074 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3c560cd0-298b-4905-96e5-2e397e77ca4c tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:03:54.393525 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3c560cd0-298b-4905-96e5-2e397e77ca4c tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:03:54.393951 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-3c560cd0-298b-4905-96e5-2e397e77ca4c tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:03:54.590040 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-3c560cd0-298b-4905-96e5-2e397e77ca4c tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49cda221e54e4950b080b9b4235bac39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50595c86d254a0a95712a0e3ded486a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:03:54.598679 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-3c560cd0-298b-4905-96e5-2e397e77ca4c tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] 10.222.0.16 "GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba" status: 200 len: 1756 microversion: 2.1 time: 0.218857 Oct 17 04:03:54.599269 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 520/1032] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 04:03:54 2022] GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba => generated 1756 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:03:55.622391 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-664bf1c3-f339-4892-85d0-b17b99ec8eca tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:03:55.622935 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-664bf1c3-f339-4892-85d0-b17b99ec8eca tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] [instance: 10c3063b-9969-488b-beff-64bf6f6a87ba] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:03:55.629492 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-664bf1c3-f339-4892-85d0-b17b99ec8eca tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:03:55.629974 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-664bf1c3-f339-4892-85d0-b17b99ec8eca tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:03:55.630409 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-664bf1c3-f339-4892-85d0-b17b99ec8eca tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:03:55.631104 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-664bf1c3-f339-4892-85d0-b17b99ec8eca tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:03:55.631585 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-664bf1c3-f339-4892-85d0-b17b99ec8eca tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:03:55.632119 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-664bf1c3-f339-4892-85d0-b17b99ec8eca tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:03:55.778107 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-664bf1c3-f339-4892-85d0-b17b99ec8eca tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49cda221e54e4950b080b9b4235bac39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50595c86d254a0a95712a0e3ded486a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:03:55.786971 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-664bf1c3-f339-4892-85d0-b17b99ec8eca tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] 10.222.0.16 "GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba" status: 200 len: 1756 microversion: 2.1 time: 0.168870 Oct 17 04:03:55.787567 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 513/1033] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 04:03:55 2022] GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:03:56.809753 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-2b548c16-feee-4ff7-83e1-db279428ee19 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:03:56.810391 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-2b548c16-feee-4ff7-83e1-db279428ee19 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] [instance: 10c3063b-9969-488b-beff-64bf6f6a87ba] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:03:56.817457 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2b548c16-feee-4ff7-83e1-db279428ee19 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:03:56.817931 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2b548c16-feee-4ff7-83e1-db279428ee19 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:03:56.818362 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2b548c16-feee-4ff7-83e1-db279428ee19 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:03:56.819047 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2b548c16-feee-4ff7-83e1-db279428ee19 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:03:56.819522 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2b548c16-feee-4ff7-83e1-db279428ee19 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:03:56.819943 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-2b548c16-feee-4ff7-83e1-db279428ee19 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:03:56.962153 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-2b548c16-feee-4ff7-83e1-db279428ee19 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49cda221e54e4950b080b9b4235bac39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50595c86d254a0a95712a0e3ded486a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:03:56.970225 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-2b548c16-feee-4ff7-83e1-db279428ee19 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] 10.222.0.16 "GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba" status: 200 len: 1756 microversion: 2.1 time: 0.164336 Oct 17 04:03:56.971320 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 521/1034] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 04:03:56 2022] GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:03:57.994086 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-e3ad2539-32a0-4faf-8ba7-d071294cc0f9 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:03:57.994726 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-e3ad2539-32a0-4faf-8ba7-d071294cc0f9 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] [instance: 10c3063b-9969-488b-beff-64bf6f6a87ba] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:03:58.001157 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e3ad2539-32a0-4faf-8ba7-d071294cc0f9 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:03:58.001646 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e3ad2539-32a0-4faf-8ba7-d071294cc0f9 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:03:58.002085 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e3ad2539-32a0-4faf-8ba7-d071294cc0f9 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:03:58.003463 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e3ad2539-32a0-4faf-8ba7-d071294cc0f9 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:03:58.003928 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e3ad2539-32a0-4faf-8ba7-d071294cc0f9 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:03:58.004357 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-e3ad2539-32a0-4faf-8ba7-d071294cc0f9 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:03:58.143295 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-e3ad2539-32a0-4faf-8ba7-d071294cc0f9 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49cda221e54e4950b080b9b4235bac39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50595c86d254a0a95712a0e3ded486a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:03:58.151881 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-e3ad2539-32a0-4faf-8ba7-d071294cc0f9 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] 10.222.0.16 "GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba" status: 200 len: 1756 microversion: 2.1 time: 0.161603 Oct 17 04:03:58.152477 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 514/1035] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 04:03:57 2022] GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:03:59.175043 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-6aacb8d7-2eb0-40fd-90f0-5da916b82236 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:03:59.175620 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-6aacb8d7-2eb0-40fd-90f0-5da916b82236 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] [instance: 10c3063b-9969-488b-beff-64bf6f6a87ba] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:03:59.182007 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-6aacb8d7-2eb0-40fd-90f0-5da916b82236 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:03:59.182682 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-6aacb8d7-2eb0-40fd-90f0-5da916b82236 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:03:59.183119 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-6aacb8d7-2eb0-40fd-90f0-5da916b82236 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:03:59.183839 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-6aacb8d7-2eb0-40fd-90f0-5da916b82236 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:03:59.184292 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-6aacb8d7-2eb0-40fd-90f0-5da916b82236 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:03:59.184712 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-6aacb8d7-2eb0-40fd-90f0-5da916b82236 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:03:59.335293 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-6aacb8d7-2eb0-40fd-90f0-5da916b82236 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49cda221e54e4950b080b9b4235bac39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50595c86d254a0a95712a0e3ded486a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:03:59.343748 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-6aacb8d7-2eb0-40fd-90f0-5da916b82236 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] 10.222.0.16 "GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba" status: 200 len: 1756 microversion: 2.1 time: 0.172651 Oct 17 04:03:59.344512 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 522/1036] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 04:03:59 2022] GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:04:00.365832 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-22e426d7-80a7-45c7-8edc-1af6723c4428 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:04:00.366472 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-22e426d7-80a7-45c7-8edc-1af6723c4428 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] [instance: 10c3063b-9969-488b-beff-64bf6f6a87ba] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:04:00.372805 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-22e426d7-80a7-45c7-8edc-1af6723c4428 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:04:00.373276 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-22e426d7-80a7-45c7-8edc-1af6723c4428 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:04:00.373702 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-22e426d7-80a7-45c7-8edc-1af6723c4428 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:04:00.374380 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-22e426d7-80a7-45c7-8edc-1af6723c4428 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:04:00.374829 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-22e426d7-80a7-45c7-8edc-1af6723c4428 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:04:00.375272 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-22e426d7-80a7-45c7-8edc-1af6723c4428 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:04:00.514163 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-22e426d7-80a7-45c7-8edc-1af6723c4428 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49cda221e54e4950b080b9b4235bac39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50595c86d254a0a95712a0e3ded486a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:04:00.523048 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-22e426d7-80a7-45c7-8edc-1af6723c4428 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] 10.222.0.16 "GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba" status: 200 len: 1756 microversion: 2.1 time: 0.161067 Oct 17 04:04:00.523636 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 515/1037] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 04:04:00 2022] GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:04:01.545723 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-ebb8bf44-7709-42d4-acef-69b8a57980b8 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:04:01.546370 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-ebb8bf44-7709-42d4-acef-69b8a57980b8 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] [instance: 10c3063b-9969-488b-beff-64bf6f6a87ba] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:04:01.552725 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ebb8bf44-7709-42d4-acef-69b8a57980b8 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:04:01.553206 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ebb8bf44-7709-42d4-acef-69b8a57980b8 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:04:01.553642 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ebb8bf44-7709-42d4-acef-69b8a57980b8 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:04:01.554385 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ebb8bf44-7709-42d4-acef-69b8a57980b8 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:04:01.554840 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ebb8bf44-7709-42d4-acef-69b8a57980b8 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:04:01.555298 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ebb8bf44-7709-42d4-acef-69b8a57980b8 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:04:01.704359 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-ebb8bf44-7709-42d4-acef-69b8a57980b8 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49cda221e54e4950b080b9b4235bac39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50595c86d254a0a95712a0e3ded486a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:04:01.713147 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-ebb8bf44-7709-42d4-acef-69b8a57980b8 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] 10.222.0.16 "GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba" status: 200 len: 1756 microversion: 2.1 time: 0.171293 Oct 17 04:04:01.713717 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 523/1038] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 04:04:01 2022] GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:04:02.735556 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-a8ffa0ac-f882-4ae9-95d8-a9739c38abaf tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:04:02.736153 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-a8ffa0ac-f882-4ae9-95d8-a9739c38abaf tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] [instance: 10c3063b-9969-488b-beff-64bf6f6a87ba] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:04:02.742687 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a8ffa0ac-f882-4ae9-95d8-a9739c38abaf tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:04:02.743189 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a8ffa0ac-f882-4ae9-95d8-a9739c38abaf tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:04:02.743628 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a8ffa0ac-f882-4ae9-95d8-a9739c38abaf tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:04:02.744328 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a8ffa0ac-f882-4ae9-95d8-a9739c38abaf tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:04:02.744782 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a8ffa0ac-f882-4ae9-95d8-a9739c38abaf tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:04:02.745205 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a8ffa0ac-f882-4ae9-95d8-a9739c38abaf tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:04:02.884642 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-a8ffa0ac-f882-4ae9-95d8-a9739c38abaf tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49cda221e54e4950b080b9b4235bac39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50595c86d254a0a95712a0e3ded486a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:04:02.892844 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-a8ffa0ac-f882-4ae9-95d8-a9739c38abaf tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] 10.222.0.16 "GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba" status: 200 len: 1756 microversion: 2.1 time: 0.161111 Oct 17 04:04:02.894040 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 516/1039] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 04:04:02 2022] GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:04:03.916719 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-ebc65c9b-cc48-4a13-a978-8137aafb6a2a tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:04:03.917343 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-ebc65c9b-cc48-4a13-a978-8137aafb6a2a tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] [instance: 10c3063b-9969-488b-beff-64bf6f6a87ba] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:04:03.923628 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ebc65c9b-cc48-4a13-a978-8137aafb6a2a tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:04:03.924118 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ebc65c9b-cc48-4a13-a978-8137aafb6a2a tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:04:03.924592 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ebc65c9b-cc48-4a13-a978-8137aafb6a2a tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:04:03.925873 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ebc65c9b-cc48-4a13-a978-8137aafb6a2a tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:04:03.926334 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ebc65c9b-cc48-4a13-a978-8137aafb6a2a tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:04:03.926766 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ebc65c9b-cc48-4a13-a978-8137aafb6a2a tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:04:04.063935 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-ebc65c9b-cc48-4a13-a978-8137aafb6a2a tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49cda221e54e4950b080b9b4235bac39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50595c86d254a0a95712a0e3ded486a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:04:04.072046 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-ebc65c9b-cc48-4a13-a978-8137aafb6a2a tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] 10.222.0.16 "GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba" status: 200 len: 1756 microversion: 2.1 time: 0.159248 Oct 17 04:04:04.072616 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 524/1040] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 04:04:03 2022] GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba => generated 1756 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:04:05.095894 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-a0f0d5e7-4463-49a7-b97c-ca9054d1e58c tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:04:05.097029 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-a0f0d5e7-4463-49a7-b97c-ca9054d1e58c tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] [instance: 10c3063b-9969-488b-beff-64bf6f6a87ba] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:04:05.103566 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a0f0d5e7-4463-49a7-b97c-ca9054d1e58c tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:04:05.104061 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a0f0d5e7-4463-49a7-b97c-ca9054d1e58c tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:04:05.104487 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a0f0d5e7-4463-49a7-b97c-ca9054d1e58c tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:04:05.105180 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a0f0d5e7-4463-49a7-b97c-ca9054d1e58c tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:04:05.105634 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a0f0d5e7-4463-49a7-b97c-ca9054d1e58c tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:04:05.106061 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a0f0d5e7-4463-49a7-b97c-ca9054d1e58c tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:04:05.248432 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-a0f0d5e7-4463-49a7-b97c-ca9054d1e58c tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49cda221e54e4950b080b9b4235bac39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50595c86d254a0a95712a0e3ded486a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:04:05.257273 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-a0f0d5e7-4463-49a7-b97c-ca9054d1e58c tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] 10.222.0.16 "GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba" status: 200 len: 1756 microversion: 2.1 time: 0.165303 Oct 17 04:04:05.257847 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 517/1041] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 04:04:05 2022] GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:04:06.281543 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-80337f34-844d-4931-b3f9-9dfeb400531d tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:04:06.282163 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-80337f34-844d-4931-b3f9-9dfeb400531d tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] [instance: 10c3063b-9969-488b-beff-64bf6f6a87ba] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:04:06.288642 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-80337f34-844d-4931-b3f9-9dfeb400531d tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:04:06.289129 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-80337f34-844d-4931-b3f9-9dfeb400531d tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:04:06.289565 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-80337f34-844d-4931-b3f9-9dfeb400531d tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:04:06.290270 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-80337f34-844d-4931-b3f9-9dfeb400531d tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:04:06.290730 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-80337f34-844d-4931-b3f9-9dfeb400531d tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:04:06.291154 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-80337f34-844d-4931-b3f9-9dfeb400531d tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:04:06.428756 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-80337f34-844d-4931-b3f9-9dfeb400531d tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49cda221e54e4950b080b9b4235bac39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50595c86d254a0a95712a0e3ded486a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:04:06.436819 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-80337f34-844d-4931-b3f9-9dfeb400531d tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] 10.222.0.16 "GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba" status: 200 len: 1756 microversion: 2.1 time: 0.159242 Oct 17 04:04:06.437380 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 525/1042] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 04:04:06 2022] GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba => generated 1756 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:04:07.461174 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-eac78b88-ac16-4e23-a4d2-af3f7744bdc8 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:04:07.461788 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-eac78b88-ac16-4e23-a4d2-af3f7744bdc8 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] [instance: 10c3063b-9969-488b-beff-64bf6f6a87ba] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:04:07.468147 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-eac78b88-ac16-4e23-a4d2-af3f7744bdc8 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:04:07.468623 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-eac78b88-ac16-4e23-a4d2-af3f7744bdc8 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:04:07.469052 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-eac78b88-ac16-4e23-a4d2-af3f7744bdc8 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:04:07.469737 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-eac78b88-ac16-4e23-a4d2-af3f7744bdc8 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:04:07.470183 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-eac78b88-ac16-4e23-a4d2-af3f7744bdc8 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:04:07.470598 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-eac78b88-ac16-4e23-a4d2-af3f7744bdc8 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:04:07.613360 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-eac78b88-ac16-4e23-a4d2-af3f7744bdc8 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49cda221e54e4950b080b9b4235bac39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50595c86d254a0a95712a0e3ded486a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:04:07.621760 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-eac78b88-ac16-4e23-a4d2-af3f7744bdc8 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] 10.222.0.16 "GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba" status: 200 len: 1756 microversion: 2.1 time: 0.165058 Oct 17 04:04:07.622315 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 518/1043] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 04:04:07 2022] GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:04:08.645322 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-ed9278c5-a036-487f-998a-9fdafe22701c tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:04:08.645933 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-ed9278c5-a036-487f-998a-9fdafe22701c tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] [instance: 10c3063b-9969-488b-beff-64bf6f6a87ba] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:04:08.652641 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ed9278c5-a036-487f-998a-9fdafe22701c tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:04:08.653127 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ed9278c5-a036-487f-998a-9fdafe22701c tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:04:08.653568 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ed9278c5-a036-487f-998a-9fdafe22701c tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:04:08.654266 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ed9278c5-a036-487f-998a-9fdafe22701c tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:04:08.654726 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ed9278c5-a036-487f-998a-9fdafe22701c tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:04:08.655155 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ed9278c5-a036-487f-998a-9fdafe22701c tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:04:08.798891 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-ed9278c5-a036-487f-998a-9fdafe22701c tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49cda221e54e4950b080b9b4235bac39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50595c86d254a0a95712a0e3ded486a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:04:08.806978 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-ed9278c5-a036-487f-998a-9fdafe22701c tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] 10.222.0.16 "GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba" status: 200 len: 1756 microversion: 2.1 time: 0.166182 Oct 17 04:04:08.807570 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 526/1044] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 04:04:08 2022] GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:04:09.829566 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-1e96f03a-de51-4db9-9ebd-05167192b659 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:04:09.830189 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-1e96f03a-de51-4db9-9ebd-05167192b659 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] [instance: 10c3063b-9969-488b-beff-64bf6f6a87ba] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:04:09.836583 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1e96f03a-de51-4db9-9ebd-05167192b659 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:04:09.837064 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1e96f03a-de51-4db9-9ebd-05167192b659 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:04:09.837498 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1e96f03a-de51-4db9-9ebd-05167192b659 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:04:09.838185 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1e96f03a-de51-4db9-9ebd-05167192b659 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:04:09.838637 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1e96f03a-de51-4db9-9ebd-05167192b659 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:04:09.839058 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-1e96f03a-de51-4db9-9ebd-05167192b659 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:04:09.982223 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-1e96f03a-de51-4db9-9ebd-05167192b659 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49cda221e54e4950b080b9b4235bac39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50595c86d254a0a95712a0e3ded486a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:04:09.990462 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-1e96f03a-de51-4db9-9ebd-05167192b659 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] 10.222.0.16 "GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba" status: 200 len: 1759 microversion: 2.1 time: 0.164721 Oct 17 04:04:09.991021 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 519/1045] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 04:04:09 2022] GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba => generated 1759 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:04:42.363515 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-64087271-d2c3-43ed-b283-33d48b104003 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1569175143"}} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:04:42.364054 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-64087271-d2c3-43ed-b283-33d48b104003 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] [instance: 10c3063b-9969-488b-beff-64bf6f6a87ba] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:04:42.366663 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_api:SELECT=16 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:04:42.367502 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG dbcounter [-] [125871] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:04:42.372762 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-64087271-d2c3-43ed-b283-33d48b104003 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:04:42.373240 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-64087271-d2c3-43ed-b283-33d48b104003 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:04:42.373672 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-64087271-d2c3-43ed-b283-33d48b104003 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:04:42.374355 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-64087271-d2c3-43ed-b283-33d48b104003 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:04:42.374803 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-64087271-d2c3-43ed-b283-33d48b104003 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:04:42.375248 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-64087271-d2c3-43ed-b283-33d48b104003 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:04:42.500678 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.network.security_group_api [None req-64087271-d2c3-43ed-b283-33d48b104003 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Removing security group c3535a50-5a68-4e81-872e-525ed2a186a6 from port 610c24b4-0b64-4a74-834c-db4774ff0d87 Oct 17 04:04:42.869746 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-64087271-d2c3-43ed-b283-33d48b104003 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] 10.222.0.16 "POST /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba/action" status: 202 len: 0 microversion: 2.1 time: 0.510543 Oct 17 04:04:42.877215 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 527/1046] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 17 04:04:42 2022] POST /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba/action => generated 0 bytes in 519 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 04:04:42.882192 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [req-c40ecd46-2f38-4b0a-97f4-a0a60bb11890 req-ee50629e-0a55-4fc9-9be9-19df4cfb19a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10c3063b-9969-488b-beff-64bf6f6a87ba", "tag": "610c24b4-0b64-4a74-834c-db4774ff0d87"}]} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:04:42.892182 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_api:SELECT=16 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:04:42.893650 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG dbcounter [-] [125872] Writing DB stats nova_cell1:SELECT=48 {{(pid=125872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:04:42.895158 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 04:04:42.895369 dv-cinder-815582-16-smb devstack@n-api.service[125872]: Mon Oct 17 04:04:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Oct 17 04:04:42.898933 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-c40ecd46-2f38-4b0a-97f4-a0a60bb11890 req-ee50629e-0a55-4fc9-9be9-19df4cfb19a2 service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:04:42.899432 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-c40ecd46-2f38-4b0a-97f4-a0a60bb11890 req-ee50629e-0a55-4fc9-9be9-19df4cfb19a2 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:04:42.899861 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-c40ecd46-2f38-4b0a-97f4-a0a60bb11890 req-ee50629e-0a55-4fc9-9be9-19df4cfb19a2 service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:04:42.914029 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.compute.server_external_events [req-c40ecd46-2f38-4b0a-97f4-a0a60bb11890 req-ee50629e-0a55-4fc9-9be9-19df4cfb19a2 service nova] Creating event network-changed:610c24b4-0b64-4a74-834c-db4774ff0d87 for instance 10c3063b-9969-488b-beff-64bf6f6a87ba on hv-cinder-81558 Oct 17 04:04:42.919820 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [req-c40ecd46-2f38-4b0a-97f4-a0a60bb11890 req-ee50629e-0a55-4fc9-9be9-19df4cfb19a2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041967 Oct 17 04:04:42.920836 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 520/1047] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 04:04:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:04:44.172661 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-44c23b38-e88e-40c2-b077-be653079cb77 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:04:44.173211 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-44c23b38-e88e-40c2-b077-be653079cb77 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] [instance: 10c3063b-9969-488b-beff-64bf6f6a87ba] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:04:44.179781 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-44c23b38-e88e-40c2-b077-be653079cb77 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:04:44.180273 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-44c23b38-e88e-40c2-b077-be653079cb77 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:04:44.180710 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-44c23b38-e88e-40c2-b077-be653079cb77 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:04:44.181413 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-44c23b38-e88e-40c2-b077-be653079cb77 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:04:44.181875 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-44c23b38-e88e-40c2-b077-be653079cb77 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:04:44.182312 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-44c23b38-e88e-40c2-b077-be653079cb77 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:04:44.262199 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.objects.instance [None req-44c23b38-e88e-40c2-b077-be653079cb77 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lazy-loading 'services' on Instance uuid 10c3063b-9969-488b-beff-64bf6f6a87ba {{(pid=125871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 04:04:44.490360 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-44c23b38-e88e-40c2-b077-be653079cb77 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] 10.222.0.16 "DELETE /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba/os-volume_attachments/7e8108c2-3d0a-4f9a-8405-baf1581551a1" status: 202 len: 0 microversion: 2.1 time: 0.322050 Oct 17 04:04:44.490977 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 528/1048] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Oct 17 04:04:44 2022] DELETE /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba/os-volume_attachments/7e8108c2-3d0a-4f9a-8405-baf1581551a1 => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 04:04:44.501509 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-d9c43369-3f00-4afe-aa6b-e2ba62ccd053 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:04:44.504780 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-d9c43369-3f00-4afe-aa6b-e2ba62ccd053 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] [instance: 10c3063b-9969-488b-beff-64bf6f6a87ba] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:04:44.515126 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d9c43369-3f00-4afe-aa6b-e2ba62ccd053 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:04:44.515636 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d9c43369-3f00-4afe-aa6b-e2ba62ccd053 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:04:44.516092 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d9c43369-3f00-4afe-aa6b-e2ba62ccd053 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:04:44.516802 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d9c43369-3f00-4afe-aa6b-e2ba62ccd053 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:04:44.517301 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d9c43369-3f00-4afe-aa6b-e2ba62ccd053 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:04:44.517730 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-d9c43369-3f00-4afe-aa6b-e2ba62ccd053 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:04:44.548700 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-d9c43369-3f00-4afe-aa6b-e2ba62ccd053 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] 10.222.0.16 "GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052185 Oct 17 04:04:44.549521 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 521/1049] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 17 04:04:44 2022] GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:04:44.936628 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [req-19bc3311-78b6-4a27-8179-205e107f4871 req-0eada0a4-2f41-4d53-8dfe-6bd4bd1a6ffc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10c3063b-9969-488b-beff-64bf6f6a87ba", "tag": "610c24b4-0b64-4a74-834c-db4774ff0d87"}]} {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:04:44.946897 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-19bc3311-78b6-4a27-8179-205e107f4871 req-0eada0a4-2f41-4d53-8dfe-6bd4bd1a6ffc service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:04:44.947446 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-19bc3311-78b6-4a27-8179-205e107f4871 req-0eada0a4-2f41-4d53-8dfe-6bd4bd1a6ffc service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:04:44.947937 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [req-19bc3311-78b6-4a27-8179-205e107f4871 req-0eada0a4-2f41-4d53-8dfe-6bd4bd1a6ffc service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:04:44.958807 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.compute.server_external_events [req-19bc3311-78b6-4a27-8179-205e107f4871 req-0eada0a4-2f41-4d53-8dfe-6bd4bd1a6ffc service nova] Creating event network-changed:610c24b4-0b64-4a74-834c-db4774ff0d87 for instance 10c3063b-9969-488b-beff-64bf6f6a87ba on hv-cinder-81558 Oct 17 04:04:44.965021 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [req-19bc3311-78b6-4a27-8179-205e107f4871 req-0eada0a4-2f41-4d53-8dfe-6bd4bd1a6ffc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032202 Oct 17 04:04:44.965995 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 529/1050] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 04:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 04:04:45.561050 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-a9e27b86-c785-4e2c-9d4b-30474a74164a tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:04:45.563289 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-a9e27b86-c785-4e2c-9d4b-30474a74164a tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] [instance: 10c3063b-9969-488b-beff-64bf6f6a87ba] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:04:45.569554 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a9e27b86-c785-4e2c-9d4b-30474a74164a tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:04:45.570040 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a9e27b86-c785-4e2c-9d4b-30474a74164a tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:04:45.570479 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a9e27b86-c785-4e2c-9d4b-30474a74164a tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:04:45.571207 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a9e27b86-c785-4e2c-9d4b-30474a74164a tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:04:45.571748 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a9e27b86-c785-4e2c-9d4b-30474a74164a tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:04:45.576671 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-a9e27b86-c785-4e2c-9d4b-30474a74164a tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:04:45.599976 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-a9e27b86-c785-4e2c-9d4b-30474a74164a tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] 10.222.0.16 "GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043089 Oct 17 04:04:45.601045 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 522/1051] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 17 04:04:45 2022] GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 04:04:45.612100 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-ba2d4e92-2b68-4620-98a1-ddce93f71441 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:04:45.612685 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-ba2d4e92-2b68-4620-98a1-ddce93f71441 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] [instance: 10c3063b-9969-488b-beff-64bf6f6a87ba] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:04:45.619899 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ba2d4e92-2b68-4620-98a1-ddce93f71441 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:04:45.620378 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ba2d4e92-2b68-4620-98a1-ddce93f71441 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:04:45.620813 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ba2d4e92-2b68-4620-98a1-ddce93f71441 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:04:45.621500 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ba2d4e92-2b68-4620-98a1-ddce93f71441 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:04:45.621956 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ba2d4e92-2b68-4620-98a1-ddce93f71441 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:04:45.622381 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-ba2d4e92-2b68-4620-98a1-ddce93f71441 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:04:45.696474 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.wsgi [None req-ba2d4e92-2b68-4620-98a1-ddce93f71441 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] HTTP exception thrown: Instance 10c3063b-9969-488b-beff-64bf6f6a87ba is not attached to volume 7e8108c2-3d0a-4f9a-8405-baf1581551a1 Oct 17 04:04:45.698803 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-ba2d4e92-2b68-4620-98a1-ddce93f71441 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Request method failure captured: Oct 17 04:04:45.698803 dv-cinder-815582-16-smb devstack@n-api.service[125871]: request: DELETE /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba/os-volume_attachments/7e8108c2-3d0a-4f9a-8405-baf1581551a1 HTTP/1.1 Oct 17 04:04:45.698803 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Accept: application/json Oct 17 04:04:45.698803 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Accept-Encoding: identity Oct 17 04:04:45.698803 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Connection: close Oct 17 04:04:45.698803 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Content-Length: 0 Oct 17 04:04:45.698803 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Content-Type: application/json Oct 17 04:04:45.698803 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Host: 10.222.0.16 Oct 17 04:04:45.698803 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Openstack-System-Scope: None Oct 17 04:04:45.698803 dv-cinder-815582-16-smb devstack@n-api.service[125871]: User-Agent: python-urllib3/1.26.12 Oct 17 04:04:45.698803 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Auth-Token: gAAAAABjTNPj5apdgm5BtBb6izEWOPtbsUsrtEMqS5pD44iI1FVGSOU9Z2DlhSgDr5WWO5p_mxPDonHEMT1gBDWjbIWJOZAYMG81qLhOjsunhPpDfJV6tEjGWPRcvZTkNnAiLw3sezHrB_RyOtcK8UX7xH4v5Ru2fmrK1x0m8Dv7mdQFO-vN9pc Oct 17 04:04:45.698803 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Domain-Id: None Oct 17 04:04:45.698803 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Domain-Name: None Oct 17 04:04:45.698803 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Identity-Status: Confirmed Oct 17 04:04:45.698803 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Is-Admin-Project: True Oct 17 04:04:45.698803 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Domain-Id: default Oct 17 04:04:45.698803 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Domain-Name: Default Oct 17 04:04:45.698803 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Id: d50595c86d254a0a95712a0e3ded486a Oct 17 04:04:45.698803 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Name: tempest-TestMinimumBasicScenario-700952173 Oct 17 04:04:45.698803 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Role: reader,member Oct 17 04:04:45.698803 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Roles: reader,member Oct 17 04:04:45.700573 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d50595c86d254a0a95712a0e3ded486a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d50595c86d254a0a95712a0e3ded486a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d50595c86d254a0a95712a0e3ded486a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d50595c86d254a0a95712a0e3ded486a", "adminURL": "http://10.222.0.16:8080"}]}] Oct 17 04:04:45.700573 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant: tempest-TestMinimumBasicScenario-700952173 Oct 17 04:04:45.700573 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant-Id: d50595c86d254a0a95712a0e3ded486a Oct 17 04:04:45.700573 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant-Name: tempest-TestMinimumBasicScenario-700952173 Oct 17 04:04:45.700573 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User: tempest-TestMinimumBasicScenario-700952173-project Oct 17 04:04:45.700573 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Domain-Id: default Oct 17 04:04:45.700573 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Domain-Name: Default Oct 17 04:04:45.700573 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Id: 49cda221e54e4950b080b9b4235bac39 Oct 17 04:04:45.700573 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Name: tempest-TestMinimumBasicScenario-700952173-project Oct 17 04:04:45.700573 dv-cinder-815582-16-smb devstack@n-api.service[125871]: method: > Oct 17 04:04:45.700573 dv-cinder-815582-16-smb devstack@n-api.service[125871]: exception: Instance 10c3063b-9969-488b-beff-64bf6f6a87ba is not attached to volume 7e8108c2-3d0a-4f9a-8405-baf1581551a1 Oct 17 04:04:45.701621 dv-cinder-815582-16-smb devstack@n-api.service[125871]: action_args: {'server_id': '10c3063b-9969-488b-beff-64bf6f6a87ba', 'id': '7e8108c2-3d0a-4f9a-8405-baf1581551a1'} Oct 17 04:04:45.701621 dv-cinder-815582-16-smb devstack@n-api.service[125871]: {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:04:45.701621 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:04:45.701621 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 17 04:04:45.701621 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 17 04:04:45.701621 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 04:04:45.701621 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 04:04:45.701621 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 17 04:04:45.701621 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 17 04:04:45.701621 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 7e8108c2-3d0a-4f9a-8405-baf1581551a1. Oct 17 04:04:45.701621 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 04:04:45.701621 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:04:45.701621 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 04:04:45.701621 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:04:45.701621 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:04:45.701621 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:04:45.701621 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:04:45.701621 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:04:45.701621 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:04:45.703488 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:04:45.703488 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 17 04:04:45.703488 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 17 04:04:45.703488 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10c3063b-9969-488b-beff-64bf6f6a87ba is not attached to volume 7e8108c2-3d0a-4f9a-8405-baf1581551a1 Oct 17 04:04:45.703488 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 04:04:45.703488 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:04:45.703488 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 04:04:45.703488 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:04:45.703488 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:04:45.703488 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:04:45.703488 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:04:45.703488 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:04:45.703488 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10c3063b-9969-488b-beff-64bf6f6a87ba is not attached to volume 7e8108c2-3d0a-4f9a-8405-baf1581551a1 Oct 17 04:04:45.703488 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 04:04:45.703488 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-ba2d4e92-2b68-4620-98a1-ddce93f71441 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Returning 404 to user: Instance 10c3063b-9969-488b-beff-64bf6f6a87ba is not attached to volume 7e8108c2-3d0a-4f9a-8405-baf1581551a1 {{(pid=125871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:04:45.704825 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-ba2d4e92-2b68-4620-98a1-ddce93f71441 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] 10.222.0.16 "DELETE /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba/os-volume_attachments/7e8108c2-3d0a-4f9a-8405-baf1581551a1" status: 404 len: 154 microversion: 2.1 time: 0.092513 Oct 17 04:04:45.704825 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 530/1052] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Oct 17 04:04:45 2022] DELETE /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba/os-volume_attachments/7e8108c2-3d0a-4f9a-8405-baf1581551a1 => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 04:04:46.940201 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-3f35aeda-19cb-4983-b679-596552e35d36 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:04:46.940722 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-3f35aeda-19cb-4983-b679-596552e35d36 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] [instance: 10c3063b-9969-488b-beff-64bf6f6a87ba] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:04:46.946953 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-3f35aeda-19cb-4983-b679-596552e35d36 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:04:46.947462 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-3f35aeda-19cb-4983-b679-596552e35d36 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:04:46.947893 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-3f35aeda-19cb-4983-b679-596552e35d36 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:04:46.948573 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-3f35aeda-19cb-4983-b679-596552e35d36 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:04:46.949025 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-3f35aeda-19cb-4983-b679-596552e35d36 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:04:46.949444 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-3f35aeda-19cb-4983-b679-596552e35d36 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:04:46.973312 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-3f35aeda-19cb-4983-b679-596552e35d36 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] [instance: 10c3063b-9969-488b-beff-64bf6f6a87ba] Going to try to terminate instance {{(pid=125872) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 04:04:47.291235 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-3f35aeda-19cb-4983-b679-596552e35d36 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] 10.222.0.16 "DELETE /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba" status: 204 len: 0 microversion: 2.1 time: 0.354507 Oct 17 04:04:47.291830 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 523/1053] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 17 04:04:46 2022] DELETE /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 04:04:47.300000 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-97e58861-4c32-4f6e-b54f-e4c02a6d8876 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:04:47.300639 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-97e58861-4c32-4f6e-b54f-e4c02a6d8876 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] [instance: 10c3063b-9969-488b-beff-64bf6f6a87ba] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:04:47.307073 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-97e58861-4c32-4f6e-b54f-e4c02a6d8876 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:04:47.307593 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-97e58861-4c32-4f6e-b54f-e4c02a6d8876 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:04:47.308022 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-97e58861-4c32-4f6e-b54f-e4c02a6d8876 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:04:47.308704 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-97e58861-4c32-4f6e-b54f-e4c02a6d8876 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:04:47.309153 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-97e58861-4c32-4f6e-b54f-e4c02a6d8876 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:04:47.309572 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-97e58861-4c32-4f6e-b54f-e4c02a6d8876 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:04:47.441500 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-97e58861-4c32-4f6e-b54f-e4c02a6d8876 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49cda221e54e4950b080b9b4235bac39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50595c86d254a0a95712a0e3ded486a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:04:47.449900 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-97e58861-4c32-4f6e-b54f-e4c02a6d8876 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] 10.222.0.16 "GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba" status: 200 len: 1554 microversion: 2.1 time: 0.153788 Oct 17 04:04:47.450490 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 531/1054] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 04:04:47 2022] GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:04:48.473271 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-ff5ea142-3e3f-4e87-835b-adc22e66640f tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Calling method '>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:04:48.473975 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.compute.api [None req-ff5ea142-3e3f-4e87-835b-adc22e66640f tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] [instance: 10c3063b-9969-488b-beff-64bf6f6a87ba] Fetching instance by UUID {{(pid=125872) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:04:48.480935 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ff5ea142-3e3f-4e87-835b-adc22e66640f tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:04:48.481411 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ff5ea142-3e3f-4e87-835b-adc22e66640f tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:04:48.481881 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ff5ea142-3e3f-4e87-835b-adc22e66640f tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:04:48.482559 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ff5ea142-3e3f-4e87-835b-adc22e66640f tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:04:48.483005 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ff5ea142-3e3f-4e87-835b-adc22e66640f tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:04:48.483447 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [None req-ff5ea142-3e3f-4e87-835b-adc22e66640f tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:04:48.608454 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.policy [None req-ff5ea142-3e3f-4e87-835b-adc22e66640f tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49cda221e54e4950b080b9b4235bac39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50595c86d254a0a95712a0e3ded486a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125872) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:04:48.616115 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-ff5ea142-3e3f-4e87-835b-adc22e66640f tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] 10.222.0.16 "GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba" status: 200 len: 1554 microversion: 2.1 time: 0.147079 Oct 17 04:04:48.616689 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 524/1055] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 04:04:48 2022] GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba => generated 1554 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:04:49.639642 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-6be390a2-89a6-41ae-916b-5987b3d62a39 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:04:49.640321 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-6be390a2-89a6-41ae-916b-5987b3d62a39 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] [instance: 10c3063b-9969-488b-beff-64bf6f6a87ba] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:04:49.647042 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-6be390a2-89a6-41ae-916b-5987b3d62a39 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:04:49.647572 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-6be390a2-89a6-41ae-916b-5987b3d62a39 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:04:49.648012 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-6be390a2-89a6-41ae-916b-5987b3d62a39 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:04:49.648995 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-6be390a2-89a6-41ae-916b-5987b3d62a39 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:04:49.649451 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-6be390a2-89a6-41ae-916b-5987b3d62a39 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:04:49.649879 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-6be390a2-89a6-41ae-916b-5987b3d62a39 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:04:49.713123 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.policy [None req-6be390a2-89a6-41ae-916b-5987b3d62a39 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49cda221e54e4950b080b9b4235bac39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50595c86d254a0a95712a0e3ded486a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125871) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:04:49.720994 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-6be390a2-89a6-41ae-916b-5987b3d62a39 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] 10.222.0.16 "GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba" status: 200 len: 1512 microversion: 2.1 time: 0.085242 Oct 17 04:04:49.721601 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 532/1056] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 04:04:49 2022] GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba => generated 1512 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:04:49.815699 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [req-706164bf-4de5-415b-a757-1b37b9b869f2 req-2ac66ae9-5451-47e7-8295-9a593017c12a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10c3063b-9969-488b-beff-64bf6f6a87ba", "name": "network-vif-deleted", "tag": "610c24b4-0b64-4a74-834c-db4774ff0d87"}]} {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:04:49.826372 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-706164bf-4de5-415b-a757-1b37b9b869f2 req-2ac66ae9-5451-47e7-8295-9a593017c12a service nova] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:04:49.831248 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-706164bf-4de5-415b-a757-1b37b9b869f2 req-2ac66ae9-5451-47e7-8295-9a593017c12a service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:04:49.831248 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG oslo_concurrency.lockutils [req-706164bf-4de5-415b-a757-1b37b9b869f2 req-2ac66ae9-5451-47e7-8295-9a593017c12a service nova] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:04:49.839102 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.compute.server_external_events [req-706164bf-4de5-415b-a757-1b37b9b869f2 req-2ac66ae9-5451-47e7-8295-9a593017c12a service nova] Creating event network-vif-deleted:610c24b4-0b64-4a74-834c-db4774ff0d87 for instance 10c3063b-9969-488b-beff-64bf6f6a87ba on hv-cinder-81558 Oct 17 04:04:49.844398 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [req-706164bf-4de5-415b-a757-1b37b9b869f2 req-2ac66ae9-5451-47e7-8295-9a593017c12a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087316 Oct 17 04:04:49.845564 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 525/1057] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 04:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:04:50.744421 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-c3d31447-274a-4334-ad02-0bc0a3268516 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Calling method '>' {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:04:50.745039 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.compute.api [None req-c3d31447-274a-4334-ad02-0bc0a3268516 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] [instance: 10c3063b-9969-488b-beff-64bf6f6a87ba] Fetching instance by UUID {{(pid=125871) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:04:50.751638 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c3d31447-274a-4334-ad02-0bc0a3268516 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:04:50.752063 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c3d31447-274a-4334-ad02-0bc0a3268516 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:04:50.752499 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c3d31447-274a-4334-ad02-0bc0a3268516 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:04:50.753205 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c3d31447-274a-4334-ad02-0bc0a3268516 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Acquiring lock "362d8516-367c-40ac-bf4b-219a46bd8926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:04:50.753661 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c3d31447-274a-4334-ad02-0bc0a3268516 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:04:50.754086 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG oslo_concurrency.lockutils [None req-c3d31447-274a-4334-ad02-0bc0a3268516 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Lock "362d8516-367c-40ac-bf4b-219a46bd8926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:04:50.768831 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.wsgi [None req-c3d31447-274a-4334-ad02-0bc0a3268516 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] HTTP exception thrown: Instance 10c3063b-9969-488b-beff-64bf6f6a87ba could not be found. Oct 17 04:04:50.770381 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-c3d31447-274a-4334-ad02-0bc0a3268516 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Request method failure captured: Oct 17 04:04:50.770381 dv-cinder-815582-16-smb devstack@n-api.service[125871]: request: GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba HTTP/1.1 Oct 17 04:04:50.770381 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Accept: application/json Oct 17 04:04:50.770381 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Accept-Encoding: identity Oct 17 04:04:50.770381 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Connection: close Oct 17 04:04:50.770381 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Content-Length: 0 Oct 17 04:04:50.770381 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Content-Type: application/json Oct 17 04:04:50.770381 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Host: 10.222.0.16 Oct 17 04:04:50.770381 dv-cinder-815582-16-smb devstack@n-api.service[125871]: Openstack-System-Scope: None Oct 17 04:04:50.770381 dv-cinder-815582-16-smb devstack@n-api.service[125871]: User-Agent: python-urllib3/1.26.12 Oct 17 04:04:50.770381 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Auth-Token: gAAAAABjTNPj5apdgm5BtBb6izEWOPtbsUsrtEMqS5pD44iI1FVGSOU9Z2DlhSgDr5WWO5p_mxPDonHEMT1gBDWjbIWJOZAYMG81qLhOjsunhPpDfJV6tEjGWPRcvZTkNnAiLw3sezHrB_RyOtcK8UX7xH4v5Ru2fmrK1x0m8Dv7mdQFO-vN9pc Oct 17 04:04:50.770381 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Domain-Id: None Oct 17 04:04:50.770381 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Domain-Name: None Oct 17 04:04:50.770381 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Identity-Status: Confirmed Oct 17 04:04:50.770381 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Is-Admin-Project: True Oct 17 04:04:50.770381 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Domain-Id: default Oct 17 04:04:50.770381 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Domain-Name: Default Oct 17 04:04:50.770381 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Id: d50595c86d254a0a95712a0e3ded486a Oct 17 04:04:50.770381 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Project-Name: tempest-TestMinimumBasicScenario-700952173 Oct 17 04:04:50.770381 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Role: reader,member Oct 17 04:04:50.770381 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Roles: reader,member Oct 17 04:04:50.772308 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d50595c86d254a0a95712a0e3ded486a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d50595c86d254a0a95712a0e3ded486a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d50595c86d254a0a95712a0e3ded486a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d50595c86d254a0a95712a0e3ded486a", "adminURL": "http://10.222.0.16:8080"}]}] Oct 17 04:04:50.772308 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant: tempest-TestMinimumBasicScenario-700952173 Oct 17 04:04:50.772308 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant-Id: d50595c86d254a0a95712a0e3ded486a Oct 17 04:04:50.772308 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-Tenant-Name: tempest-TestMinimumBasicScenario-700952173 Oct 17 04:04:50.772308 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User: tempest-TestMinimumBasicScenario-700952173-project Oct 17 04:04:50.772308 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Domain-Id: default Oct 17 04:04:50.772308 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Domain-Name: Default Oct 17 04:04:50.772308 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Id: 49cda221e54e4950b080b9b4235bac39 Oct 17 04:04:50.772308 dv-cinder-815582-16-smb devstack@n-api.service[125871]: X-User-Name: tempest-TestMinimumBasicScenario-700952173-project Oct 17 04:04:50.772308 dv-cinder-815582-16-smb devstack@n-api.service[125871]: method: > Oct 17 04:04:50.772308 dv-cinder-815582-16-smb devstack@n-api.service[125871]: exception: Instance 10c3063b-9969-488b-beff-64bf6f6a87ba could not be found. Oct 17 04:04:50.772308 dv-cinder-815582-16-smb devstack@n-api.service[125871]: action_args: {'id': '10c3063b-9969-488b-beff-64bf6f6a87ba'} Oct 17 04:04:50.774019 dv-cinder-815582-16-smb devstack@n-api.service[125871]: {{(pid=125871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:04:50.774019 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:04:50.774019 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 04:04:50.774019 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 04:04:50.774019 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 04:04:50.774019 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 04:04:50.774019 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 04:04:50.774019 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 04:04:50.774019 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 04:04:50.774019 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 04:04:50.774019 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10c3063b-9969-488b-beff-64bf6f6a87ba could not be found. Oct 17 04:04:50.774019 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 04:04:50.774019 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:04:50.774019 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 04:04:50.774019 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:04:50.774019 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:04:50.774019 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:04:50.774019 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:04:50.774019 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:04:50.774019 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:04:50.775503 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:04:50.775503 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 04:04:50.775503 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 04:04:50.775503 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 04:04:50.775503 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 04:04:50.775503 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 04:04:50.775503 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:04:50.775503 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10c3063b-9969-488b-beff-64bf6f6a87ba could not be found. Oct 17 04:04:50.775503 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 04:04:50.775503 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:04:50.775503 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 04:04:50.775503 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:04:50.775503 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:04:50.775503 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:04:50.775503 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:04:50.775503 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:04:50.775503 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10c3063b-9969-488b-beff-64bf6f6a87ba could not be found. Oct 17 04:04:50.775503 dv-cinder-815582-16-smb devstack@n-api.service[125871]: ERROR nova.api.openstack.wsgi Oct 17 04:04:50.777094 dv-cinder-815582-16-smb devstack@n-api.service[125871]: DEBUG nova.api.openstack.wsgi [None req-c3d31447-274a-4334-ad02-0bc0a3268516 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Returning 404 to user: Instance 10c3063b-9969-488b-beff-64bf6f6a87ba could not be found. {{(pid=125871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:04:50.777094 dv-cinder-815582-16-smb devstack@n-api.service[125871]: INFO nova.api.openstack.requestlog [None req-c3d31447-274a-4334-ad02-0bc0a3268516 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] 10.222.0.16 "GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba" status: 404 len: 111 microversion: 2.1 time: 0.031368 Oct 17 04:04:50.777094 dv-cinder-815582-16-smb devstack@n-api.service[125871]: [pid: 125871|app: 0|req: 533/1058] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 04:04:50 2022] GET /compute/v2.1/servers/10c3063b-9969-488b-beff-64bf6f6a87ba => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 04:04:50.783251 dv-cinder-815582-16-smb devstack@n-api.service[125872]: DEBUG nova.api.openstack.wsgi [None req-3603430d-4eb3-4270-8df4-f8b019314247 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] Calling method '.version_select at 0x7fd72a50bf70>' {{(pid=125872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:04:50.882378 dv-cinder-815582-16-smb devstack@n-api.service[125872]: INFO nova.api.openstack.requestlog [None req-3603430d-4eb3-4270-8df4-f8b019314247 tempest-TestMinimumBasicScenario-700952173 tempest-TestMinimumBasicScenario-700952173-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1107637625" status: 202 len: 0 microversion: 2.1 time: 0.104120 Oct 17 04:04:50.883594 dv-cinder-815582-16-smb devstack@n-api.service[125872]: [pid: 125872|app: 0|req: 526/1059] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Oct 17 04:04:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1107637625 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)